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CHAPTER  1 


INTRODUCTION 

Ever  since  men  Invented  the  lens  and  thus  had  a means  of 
producing  an  Image  of  the  real  world,  there  has  been  a problem  of 
characterising  the  quality  of  that  Image.  With  the  advent  of  photo- 
graphy and,  later,  television,  the  problem  of  characterizing  "Image 
quality"  In  a meaningful  fashion  has  Increased  tremendously.  The 
primary  objective  of  this  dissertation  Is  to  Investigate  and  evaluate 
display  system  "figures  of  merit"  (FOM's)  that  can  be  used  to  Indicate 
the  image  quality  of  television  systems. 

There  are  two  approaches  that  can  be  taken  toward  determining 
functional  Image  quality:  subjective  and  objective.  The  subjective 
approach  compares  analytically  derived  measures  of  image  quality  with 
the  subjective  assessment  of  image  quality  as  determined  by  human 
observers.  The  objective  approach  compares  the  analytically  derived 
Image  quality  measures  with  a performance  variable  associated  with  a 
particular  observer  task.  Typical  performance  variables  are  response 
time,  number  of  correct  responses,  size  of  target  at  recognition,  and 
slant  range  (distance)  to  target  at  recognition/detection  (see 
Appendix  A).  Almost  all  observer  tasks  involve  recognition,  detection 
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or  identification  of  come  type  of  target,  Targets  may  be  real  objects 
such  as  vehicles,  buildings,  or  faceB,  or  they  may  be  artificial  such  as 
tri-bar  patterns,  rectangles,  or  sine  waves. 

The  typical  objective  image  quality  assessment  study  investi- 
gates the  effect  of  two  or  three  display  variables  on  the  image  quality 
measure  being  considered  and  the  resulting  observer  performance. 

Table  1 shows  a listing  of  parameters  used  to  describe  a video  display 
system. 

There  are  two  basic  subcategories  of  objective  image  quality 
assessment  studies:  1)  studies  which  employ  a method  intended  to 
predict  absolute  observer  performance  levels,  2)  studies  which  compare 
the  correlation  of  a generalized  FOM  with  observer  performance.  The 
first  type  is  mors  difficult  and  is  typically  applied  to  artificial 
targets.  The  second  type  provides  a relative  measure  of  image  quality 
(if  it  is  successful)  but  does  not  give  information  as  to  the  absolute 
performance  level  that  can  be  expected.  This  dissertation  primarily 
addresses  the  second  subcategory. 

It  is  apparent  from  the  vast  number  of  combinations  of  target 
type,  observer  tasks,  display  variables,  and  display  types  that  it  is 
nearly  Impossible  to  make  meaningful  comparisons  among  studies  found  in 
the  literature.  Nevertheless,  Chapter  2 of  this  dissertation  provides  a 
summary  review  of  the  literature  and  attempts  to  evaluate  and  compare 
the  various  FOM's  proposed  therein. 
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Tabla  1 . Television  display  system  parameters 


Geometric 

Electronic 

Photometric 

Viewing  Olatance 

Bandwidth 

Luminance 

Display  Siae 

Dynamic  Ranga 

Gray  Shades 

Aspect  Ratio 

Signal/No iee 

Contrast  Ratio 

Number  of  Scan  tinea 

Frame  Rate 

Halation 

Interlace  Ratio 

Field  Rate 

Ambient  Illuminance 

Scan  tine  Spacing 

Color 

tinaarity 

Resolution 

Spot  Sise 

MTF 

Luminance  Uniformity 

Gamma 

To  define  sn  area  that  can  be  reasonably  investigated  in  this 
dissertation,  only  display  systems  operating  under  relatively  low  noise 
level  conditions  are  considered.  Even  within  this  defined  ares,  it  is 
found  that  no  investig  tion  has  attempted  to  apply  more  that  three  FOM's 
to  the  same  observer  performance  data  to  determine  which  one  yields  the 
beat  correlation.  Chapter  3 provides  a brief  discussion  on  each  of  the 
FOM's  under  consideration.  Chapter  4 describes  a target  detection  and 
target  recognition  study  that  was  done  to  provide  baseline  performance 
data  tor  comparing  the  FOM's.  Chapter  b describee  a previous  target 


recognition  study  that  compares  the  performance  of  subjects  in  that 
experiment  to  the  calculated  values  of  each  of  18  FOM's.  A discussion 
of  the  concept  of  FOM's  and  a target  recognition  model  are  provided  in 
Chapter  6.  The  conclusions  are  given  in  Chapter  7. 

There  are  several  terms  with  which  the  reader  may  not  be  familiar 
or  that  may  have  multiple  meanings.  To  minimize  the  possibility  of 
confusion,  the  following  list  of  terms  and  definitions  is  provided: 


by  3 dB,  or  50  percent,  with  reipect  to  the  input  eignel  (see 
definition  of  Geuseien  MTF) . 

Contrast:  There  are  many  definitions  of  contrast;  only  one  la  used 
throughout  this  dissertation.  Contrast  ia  defined  as  the 
maximum  luminance  minus  the  minimum  luminance  divided  by  the  sum 
of  the  two.  This  term  ia  used  Interchangeably  with  the  terms, 
"modulation"  and  "modulation  contrast"  and  is  denoted  by  the 
symbol  M. 

Contrast  ratio:  This  is  defined  as  the  ratio  of  the  maximum  luminance 
to  the  minimum  luminance.  It  is  not  the  same  as  contrast  but  iu 
related  to  contrast  by  the  following  equation: 


1 + M 
1 - M 


CD 


where 

Cr  ■ contrast  ratio 
M - contrast  (or  modulation) 

Contrast  sensitivity  function:  The  reciprocal  of  the  contrast  threshold 
function. 

Contrast  threshold  function:  The  eye  requires  a certain  minimum  level 
of  contrast  before  it  is  able  to  detect  the  presence  of  a 
spatially  varying  sine-wave  pattern.  This  level  depends  on  the 
spatial  frequency  of  the  sine-wave  pattern.  The  level  of  contrast 


s 


required  for  an  observer  to  detect  the  presence  of  the  pattern 
with  a 50  percent  probability  level,  described  ae  a function  of 
angular  spatial  frequency,  is  defined  aa  the  contrast  threshold 
function. 

Correlation:  The  correlation  coefficient,  r,  ranges  in  value  from 

r ■ 0,  indicating  no  relationship  between  the  two  variables  to 
r ■ ±1,  indicating  a perfect  linear  relationship  between  the  two 
variables.  The  negative  sign  corresponds  to  a negative  sloping 
line  and  the  positive  sign  to  a positive  sloping  lino.  The 
equation  used  to  calculate  r,  is  discussed  in  Mathematical 
Statistics  by  J.  E.  Freund  (1962). 

Frame  rate:  This  is  the  rapidity  with  which  the  video  picture  is  fully 
updated.  For  standard  commercial  television  this  is  30  frames 
(or  pictures)  per  second. 

Modulation:  see  contrast 

Modulation  contrast:  see  contrast 

Modulation  factor:  see  modulation  transfer  factor 

Modulation  transfer  factor:  Thb  modulation  transfer  factor  is  the  ratio 
of  the  modulation  at  the  output  to  the  modulation  at  the  input 
of  a system  for  a particular  spatial  frequency  sine-wave 
pattern.  This  is  denoted  by  the  symbol  M. 

Modulation  transfer  function:  If  a sine-wave  pattern  is  imaged  through 
a linear  display  system,  then  the  resulting  image  is  a aina-wave 
pattern  that  may  have  a different  modulation  from  the  original. 
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Tha  ratio  of  tha  modulation  of  the  output  sine-wave  pattarn  to 
tha  modulation  of  tha  input  aina-wava  pattarn  la  tha  modulation 
tranafar  factor.  Tha  curva  describing  thia  factor  aa  a function 
of  spatial  frequency  is  tha  modulation  tranafar  function,  or 
MTF.  Thia  function  la  identified  by  tha  symbol  M(to).  Tha 
MTF  is  strictly  dafinad  only  if  tha  display  aystam  is  linear. 
However,  for  systems  that  depart  only  slightly  from  linearity, 
tha  concept  of  MTF  la  still  useful.  Such  is  tha  case  for  tha 
application  of  tha  MTF  concept  to  video  displays.  A Gaussian 
MTF  is  defined  by  tha  following  aquation: 

Mg(<u)  - a"0-693  (~f  (2) 

where 

Mg  (to)  ■ modulation  tranafar  factor 
to  ■ apatlal  frequency  variable 
to0  ■ bandwidth 

Defined  in  thia  manner  tha  value  of  Mg(to)  is  0.5  for  to  * to0. 

Thua  to0  is  the  bandwidth  of  the  display. 

Scan  line:  A video  picture  is  typically  made  up  of  a number  of 

horiaontal  lines  that  are  "painted"  on  tha  phosphor  of  the 
television  display.  This  is  done  by  an  electron  beam  inBide  the 
cathode-ray  tube  that  scans  across  the  display.  Each  of  these 
lines  of  picture  Information  is  called  a scan  line.  This  is 


not  the  same  aa  tha  numbar  of  TV  lines,  which  la  a measure  of 
resolution. 

Sine-wave  pattern!  This  la  a two-dimeneional  pattern  with  a luminance 
distribution  in  one  dimension  that  varies  as  tha  sine  of  tha 
coordinate  of  that  dimension  plus  an  average  luminance  value. 
There  is  no  luminance  variation  in  the  orthogonal  dimension. 

Spatial  frequency:  Thero  are  three  distinctly  different  spatial 

frequency  parameters.  Tha  distinction  is  sufficiently  Important 
that  each  of  these  is  represented  by  a different  Bymbol  to  avoid 
confusion.  Each  has  its  appropriate  use  in  describing  display 
systems. 

Angular  spatial  frequency,  u.  This  quantity  is  measured 
in  units  of  cycles  per  degree.  This  indicates  tha  number  of 
cycles  of  a periodic  pattern  that  subtend  an  angle  of  one  degree 
as  measured  from  a particular  viewing  distance.  It  is  typically 
used  when  one  is  interested  in  relating  to  vision  or  visual 
characteristics.  The  contrast  sensitivity  function  and  the 
contrast  threshold  function  are  expressed  in  terms  of  this 
variable. 

Linear  spatial  frequency.  There  are  two  ways  of  charac- 
terieing  linear  spatial  frequency:  in  units  of  cycles  per  unit 
length  or  cycles  per  display  width.  The  first  indicates  the 
number  of  cycles  of  a target  pattern  that  are  contained  in  a 
specified  unit  of  length  such  as  an  inch  or  centimeter.  This 
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is  denoted  by  the  symbol  and  is  commonly  used  in  optics  end 

photography • this  type  of  measure  corresponds  to  the  density  of 
information  that  can  be  transmitted  through  the  display  system. 
The  second  is  generally  used  in  television  and  denotes  twice  the 
total  number  of  cycles  (number  of  TV  lines  counting  black  and 
white  lines)  that  are  contained  along  a raster  line,  across  the 
full  width  of  the  display,  regardless  of  the  actual  display 
size.  Thia  variable  ia  Indicated  by  N,  defined  us  the  number  of 
half-cycles  across  the  display  width..  This  measure  is  appro- 
priate for  relating  to  the  total  information  the  display  ia 
capable  of  transmitting. 

These  three  spatial  frequencies  are  related  according  to 
the  following  equations: 
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where 

f - linear  spatial  frequency  (cyclea/unit  length) 

N ■ linear  spatial  frequency  (half-cycles/display  width) 
u - angular  spatial  frequency  (cycles/degree) 

W ■ display  width 
D ■ viewing  distance 
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Th*  aquation  for  w gives  the  angular  spatial  frequency  for  the 

i 

center  of  the  display  only  if  the  display  surface  is  perpen- 
dicular to  the  observer's  line  of  eight. 

Square-wave  pattern i This  is  a two-dimensional  pattern  in  which  the 

luminance  distribution  varies  a»  a square  wave  in  one  dimension. 
It  appears  as  a series  of  equal  width,  alternating  bright  and 
dark  bars. 

Transfer  factor:  see  modulation  transfer  factor. 

TV  lines  per  picture  height:  This  is  e linear  spatial  frequency  measure 
developed  by  Schade  (1953)  that  corresponds  to  the  maximum 
number  of  square-wave  half  cycles  (black  or  white  bars)  that  can 
be  resolved  along  a distance  on  a display  equal  to  the  height  of 
the  display.  Also,  referred  to  as  TV  lines  resolution.  It  is 
denoted  by  N^. 
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CHAPTER  2 


LITERATURE  REVIEW 

Th«  most  widely  used  meaaure  of  display  quality  la  limiting 
raaolutlon.  Evan  with  tha  advent  of  mote  elegant  display  measurements 
such  as  tha  modulation  transfer  function  (MTF),  display  users  still 
resort  to  limiting  resolution  as  a means  of  specifying  the  required  or 
actual  display  quality  (Brock,  1967).  Several  test  patterns  have  been 
developed  to  directly  determine  the  limiting  resolution  of  an  imaging 
system.  Figures  2,1  and  2.2  show  two  such  patterns.  Figure  2.1  is  the 
Electronic  Industries  Association  (EIA)  Resolution  Chart  (formerly 
RETKA  chart)  developed  specifically  for  use  with  television  systems,  and 
Figure,  2.2  is  the  1951  standard  U.S.  Air  Force  tri-bar  target  pattern. 

Tha  wedge  shaped  patterns  of  the  EIA  chart  are  used  to  directly 
determine  the  limiting  resolution  of  the  display  system  in  units  of  TV 
lines  par  picture  height.  Two  TV  lines  correspond  to  one  line  pair  or 
cycle  of  the  bars  making  up  tha  vedga  pattern.  The  point  at  which  the 
bars  of  tha  wedge  pattern  are  no  longer  individually  distinguishable  Is 
ths  limiting  rssolution  of  the  display  systsm.  Normally  the  procedure 
requires  that  tha  obaarver  making  ths  rssolution  dstermination  is 
sufficiently  cloee  to  the  dleplay  that  he  is  not  vision  limited.  Thus, 
tha  resolution  measure  la  strictly  a characteristic  of  the  display 


system.  However,  If  the  observer  is  required  to  view  the  display  from 
the  same  distance  at  which  the  display  will  be  used  operationally,  than 
the  resolution  measure  is  determined  by  a combination  of  the  display 
system  capability  and  the  observer’s  visual  system.  This  second  method 
is  seldom  used  but  it  should  provide  s more  reasonable  resolution  value 
since  it  is  a result  of  the  complete  display/observer  system. 

The  Air  Force  tri-bar  target  pattern  is  divided  into  seven 
groups  of  six  elements.  Each  spatiaL  frsquency  is  represented  by  a 
three-bar  pattern  oriented  vertically  and  a three-bar  pattern  oriented 
horizontally,  The  resolution  of  the  imaging  system  is  determined  by  the 
smallest  tri-bar  patt  rn  that  can  be  resolved  into  its  three  bars.  This 
limiting  resolution  is  then  specified  in  terms  of  the  group  and  element 
of  the  "Just  resolvable"  tri-bar. 

Both  of  these  methods  of  determining  limiting  resolution  require 
a subjective  assessment  from  the  observer  as  to  whether  or  not  a pattern 
is  "resolved."  This  is  not  always  an  easy  Judgment  and  can  lead  to 
considerable  variability  in  resolution  measurements  due  to  individual 
differences  between  observers.  There  is  an  alternative  approach 
(Snyder,  1974a).  Limiting  resolution  can  be  determined  by  making  use 
of  the  MTF  of  the  system  in  conjunction  with  measurements  of  the  human 
visual  contrast  threshold  curve  (Campbell  and  Robson,  1968;  Depalma 
and  Lowry,  1962), 

The  MTF  of  the  display  system  indicates  the  system's  capability 
to  transfer  contrast  from  the  input  scene  to  the  output  image  as  a 
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function  of  spatial  frequency,  Aa  such,  the  MTF  Itself  does  not  define 
a contrast  level  at  the  output  of  the  display  unless  an  input  contrast 
has  been  specified.  For  all  of  the  FdM's  that  use  the  MTF  in  conjunction 


with  the  visual  threshold  function,  there  is  an  implied  assumption  that 
the  input  cbntraat  is  100  percent  across  all  spatial  frequencies.  With 
this  assumption,  the  MTF  curve  describes  the  actual  expected  output 
contrast  as  a function  of  spatial  frequency.  This  is  a subtle  point 
but  it  should  be  noted. 

Figure  2.3  shows  how  the  display  system  MTF  end  the  visual 
threshold  function  are  used  to  determine  the  limiting  reaolution  of  the 
display  system.  The  intersection  of  the  display  system  MTF  with  the 
visual  contrast  threshold  curve  represents  the  highest  sine-wave  spatial 
frequency  that  can  be  produced  by  the  display  system  and  that  can  be 


seen  by  the  observer.  The  advantage  of  this  approach  is  the  reduction  of 
variability  in  determining  the  limiting  resolution. 

All  of  these  resolution  measures  provide  information  about  the 
high  frequency  portion  of  the  display  MTF  but  not  about  the  display 
capability  at  lowar  apatial  frequencies.  One  method  of  providing  more 
information  about  the  lower  spatial  frequency  performance  is  to  measure 
the  suprathreahold  reaolution  (Task,  Finkus,  and  Hornaeth,  1978) 
dsscrlbad  below. 

In  1968  Campbell  and  Robson  published  the  two  curves  shown  in 
Fig.  2.4,  The  right-hand  curve  is  the  often  measured  contrast  threshold 
curve  for  the  human  visual  system . This  curve  indicates  the  amount  of 
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SPATIAL  FREQUENCY 

Fig.  2.3.  Limiting  resolution  determined  by  the  Intersection  of  the 
display  system  MTF  and  the  visual  contrast  threshold 
functions 


spatial  frequency 
(CYCLES/DEGREE) 

Fig.  2.4.  Campbell  and  Robson  (1968)  study  results  showing  the  sine- 

wave  threshold  function  (right)  and  the  sine-wave  square-wave 
discrimination  curve  (left) 

The  dashed  line  is  an  extrapolation. 


contrast  required  for  a sine-wave  pattern  to  be  just  detectable  50 
percent  of  the  time  as  a function  of  angular  spatial  frequency.  The 
left-hand  curve  of  Fig.  2.4  indicates  the  amount  of  contrast  required  to 
determine  whether  the  target  pattern  being  viewed  Is  a sine-wave  or  a 
aquare-wave  target  as  a function  of  spatial  frequency.  The  Intersection 
of  this  sine-wave/square-wave  discrimination  curve  with  the  MTF  of  the 
display  system  is  defined  as  the  suprathreshold  resolution  of  the 
system. 

All  of  the  measures  described  so  far  provide  information  about 
only  a single  spatial  frequency.  A concept  that  was  proposed  to 
Incorporate  aspects  of  the  MTF  value  for  all  spatial  frequencies  Is  the 
equivalent  bandpass,  Ne  (Suhade,  1953).  The  equivalent  bandpass  is 
calculated  using  equation  3. 


Ne 


{M(Nh)}2  dNh 
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(3) 


where 

M(Nh)  - MTF  of  the  display  system 

Njj  " spatial  frequency  in  unltB  of  TV  lines  per  picture  height 
This  measure  depends  only  on  the  display  system  characteristics  and  is 
independent  of  the  visual  system  capabilities. 

Borough,  Fallls,  Warnock  and  Britt  (1967)  proposed  an  FOM  for 
film  systems  designated  the  MTFA.  Snyder  (1974a)  applied  this  measure 
to  television  systems  as  a potentially  useful  means  of  indicating  video 
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display  image  quality.  The  MTFA  is  calculated  by  computing  the  area 
between  the  MTF  of  the  diaplay  system  and  the  contrast  threshold 
function  of  the  observer.  This  is  shown  in  graphic  form  in  Fig.  2.3. 

In  equation  form  the  MTFA  is: 

MTFA  - {M(w)  - T(uj)  } du  (4) 

• o 

where 

M(u)  - angular  MTF  of  the  display  system 
T(u>)  ■ visual  contrast  threshold  function 

ui  ■ angular  spatial  frequency  (cycles/degree) 
id£  - angular  spatial  frequency  at  which  M(io)  intersects  T(u>) 
(which  is  also  the  limiting  resolution  of  the  display/ 
observer  system) 

Because  of  the  difficulty  of  producing  high  quality  sine-wave  patterns 
for  measuring  the  MTF  of  the  display  system,  Snyder  proposed  a variation 
of  the  MTFA  concept  using  square-wave  (bar)  patterns.  The  resulting 
area  measure  was  designated  MTFAsq  to  indicate  that  the  area  measured 
was  between  the  square-wave  response  of  the  television  system  and  the 
square-wave  contrast  threahold  of  the  observer.  Using  the  MTFA„q  Snyder 
(1974b)  wan  able  to  obtain  very  good  eorrelatione  with  reaction  time 
and  correct  responsea  for  a face  recognition  task.  Diaplay  quality  waa 
varied  by  changing  the  video  bandwidth,  line  rate,  and  nolae  level. 
Changing  the  line  rate  and  bandwidth  affected  the  vertical  and  hori- 
zontal resolution  of  the  display,  respectively,  and  the  noise  affected 


Che  contrast  threshold  curve  of  the  observer.  A total  of  15  display 
conditions  composed  of  different  combinations  of  line  rate,  bandwidth 
and  noise  were  used  in  the  study.  The  results  showed  good  correlations 
with  log  10  MTFABq.  Correlation  with  correct  response  was  r ■ 0.87 
(p  < 0.001)  and  with  response  time  was  r ■ 0.92  (p  < 0.001). 

Correlations  were  calculated  using  the  method  described  in  Mathematical 
Statistics  by  Freund  (1962) . 

One  criticism  of  the  MTFA  and  MTFASq  (and  similar  FOM's)  is  that 
they  are  based  on  a one-dimensional  MTF  (measured  along  the  scan  lines) 
whereas  the  display  system  provides  visual  information  in  two  dimensions. 
For  television  displays  the  problem  is  compounded  somewhat  by  the  fact 
that  the  display  is  continuous  in  one  dimension  and  discretely  sampled 
in  the  other. 

In  a later  study,  Snyder  (1976)  attempted  to  measure  directly 
the  MTF  of  the  display  in  the  direction  perpendicular  to  the  scan  lines. 
This  measured  MTF  wan  then  combined  in  various  ways  with  the  MTF  in  the 
perpendicular  direction  (along  the  Bean  lines)  to  obtain  a two-dimensional 
MTFA.  These  combinations  included  the  arithmetic  mean,  gcdmetric  mean, 
harmonic  mean,  and  the  quadratic  mean.  The  resulting  two-dimensional 
MTFA  values  were  applied  to  a target  acquisition  task  with  some  degree 
of  success. 

The  correlations  calculated  for  this  experiment  were  lower  than 
in  previous  experiments,  but  the  interesting  point  is  that  most  of  the 
two-dimensional  MTFA  values  correlated  higher  than  the  one-dimensional 


II 


MTFA  values.  However,  many  of  the  differences  in  correlation  were  not 
statistically  significant.  Correlations  with  simulated  slant  range  (see 
Appendix  A)  to  target  at  detection  and  the  number  of  correct  responses 
ranged  from  0.16  to  0.70.  Probably  part  of  the  reason  for  the  lower 
correlations  la  that  subjects  were  required  to  search  the  display 
to  acquire  the  target.  This  adds  to  the  variance  due  to  differences  In 
search  strategies  botween  subjects  and,  consequently,  tends  to  lower  the 
correlation. 

The  MTFA  concept  has  a certain  amount  of  appeal  since  it 
includes  both  characteristics  of  the  display  system  and  of  the  observer. 
However,  some  criticism  has  been  raised  as  to  the  way  in  which  the  display 
characteristics  and  the  observer  characteristics  should  be  combined, 
van  Meeteren  (1973)  suggested  that  the  MTF  of  the  display  system  should 
be  multiplied  by  the  contrast  sensitivity  function  (CSF)  of  the  visual 
system.  Since  the  CSF  is  the  reciprocal  of  the  visual  contrast  thres- 
hold curve  previously  discussed,  this  is  equivalent  to  dividing  Che  MTF 
by  the  contrast:  threshold  function.  The  resulting  quantity  has  been 
designated  the  integrated  contrast  sensitivity  (ICS): 
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where 

ICS  ■ integrated  contrast  sensitivity 
M(u)  - display  system  MTF 


(5) 
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S(ui)  ■ contract  aanaltivity  function 
T(w)  ■ contrast  threshold  function 

u)  ■ apatial  frequency  (angular  unite) 

Granger  and  Cupery  (1972)  have  propoaed  a modified  veraion  of 
the  MTFA  concept  called  the  aubjective  quality  factor  (SQF) . Although 
their  axperimenta  were  dope  ualng  film,  the  SQF  can  easily  be  applied  to 
television  systems.  In  equation  form) 
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SOF  ■ K |M(ln  w,  0)|  |Mv(ln  ut)  | d6  d(ln  id) 
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where 

K ■ normalising  factor 

a * low  spatial  frequency  integration  limit 
M(ln  u>,  6)  » two-dimensional  optical  transfer  function  of  the 
display  system  in  polar  coordinates 
Mv  ■ MTF  of  the  visual  system 
ui  ■ angular  spatial  frequency 
0 * orientation  angle  of  the  Bpatial  frequency 
Granger  (1974)  observed  that  most  of  the  visual  response  occurs 
between  3 and  12  cycles  per  degree  (cpd),  so  he  suggested  a simplified 
SQF  that  uses  a rectangular  frequency  bandpass  from  3 cpd  to  12  cpd  to 
approximate  the  visual  paseband,  (Mv(ln  id)).  The  resulting  equation 
for  SQF  is 
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SQP  ■ K jM(ln  w,e)jde  d(ln)  (7) 

' In  3 ' o 

Experiments  done  by  Granger  and  Cuprey  (1972)  and  Granger  (1974)  showed 
excellent  correlation  between  the  computed  SQF  and  the  rank  order  of 
subjectively  ranked  black  and  white  photographs  (correlation  r » 0.990). 

The  area-type  POM  provides  a conceptually  simple  method  of 
determining  the  quality  of  a display  system.  However , for  the  area-type 
FOM  approach  to  be  successful,  the  area  enclosed  must  be  isotropic  with 
respect  to  visual  effect.  That  is,  each  unit  of  area  must  contribute  as 
much  to  overall  visual  performance  as  every  other  Identically  slsed  unit 
of  area.  If  this  Is  not  the  case,  then  it  would  be  possible  to  devise 
display  conditions  that  have  the  same  MTFA  but  permit  markedly  different 
observer  performance,  It  is  therefore  desirable  to  transform  the  two 
axes  of  the  area-type  FOM  so  that  they  are  linear  with  respect  to 
visual  effect, 

Task  and  Verona  (1976)  attempted  to  produce  an  isotropic  area- 
type  FOM  by  transforming  the  modulation  contrast  axis  into  the  number 
of  /2  grey  shades.  The  resulting  gray  shade  veraue  spatial  frequency 
graph  was  then  used  to  calculate  the  area  between  the  visual  threshold 
curve  (converted  to  gray  shades)  and  the  gray-shade  response  of  the 
display  system.  This  FOM  was  designated  the  gray  shade  frequency  product 
(GFP).  Figure  2.S  shows  the  method  used  to  convert  riulation  contrast 
to  gray  ahades,  The  affect  of  this  conversion  is  to  weight  the  upper 
contract  levels  more  heavily,  as  can  be  seen  by  the  graph  in  Fig.  2.6. 
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This  type  of  weighting  is  reasonable  if  the  visual  system  responds 
logarithmically  to  luminance  levels,  which  has  been  shown  to  be  the  case 
for  moderate  luminance  levels  and  Just-noticeable  difference  (JND) 
studies  (Graham,  1965,  p.  215).  However,  more  recent  experiments 
(Carlson  and  Cohen,  1978)  have  shown  that  the  visual  system  seems  to 
respond  logarithmically  to  levels  of  modulation  contrast  of  sine-wave 
gratings.  This  type  of  transformation  would  tend  to  weight  the  lower 
contrast  levels  more  heavily  than  the  upper  contrast  levels. 

The  work  done  by  Carlson  and  Cohen  (1978)  was  directed  toward 
developing  u means  of  predicting  JND's  in  display  imaging  quality.  To 
this  end  they  developed  detectable  difference  diagrams  (ODD)  to  aid  in 
determining  how  much  of  an  Ml'F  change  can  be  tolaratad  In  a display 
system  before  the  change  is  noticed.  Figure  2.7  shows  the  ODD  they 
published  in  the  SID  (Society  for  Information  Display)  78  Digest.  One 
concept  that  is  explored  later  in  this  paper  is  the  application  of  the 
DDD  to  transform  the  area-type  FOM  to  u quantity  that  muy  be  linearly 
related  to  vision.  This  FOM  is  designated  the  Just-noticeable  differ- 
ence area  ( JNDA) . It  is  calculated  by  transforming  the  display  system 
MTF  curves  to  JND  levels  using  the  ODD  of  Carlson  und  Cohen,  then 
intdgrating  to  find  the  area  under  the  resulting  curve.  The  lower 
limit  of  integration  ia  at  one-lmlf  cycle  per  degree  since  this  is  the 
lowest  frequency  shown  on  the  DDD. 

In  the  course  of  thu  literature  review  other  FOM's  for  displays 
were  found  but  could  not  be  conaidured  for  evaluation  und  comparison 
due  to  problems  of  implementing  the  measur.  i. 
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Fig.  2. 7.  Detectable  difference  diagram  of  Carlson  and  Cohen  (1978) 

The  DDD  was  presented  by  Carlson  and  Cohen  (1978)  as  a means  of 
determining  how  much  the  MTF  of  two  displays  must  differ  before  an 
observer  can  detect  the  difference.  ThiB  DDD  shows  the  MTF's  of 
three  different  displays  on  it.  The  two  MTF's  indicated  by  the 
label  B are  just  noticeably  different  because  they  differ  by  more 
than  one  Just-noticeable  difference  (JND)  level  at  Borne  spatial 
frequency  (in  this  case,  at  12  cyclee/degree) . The  MTF  labelled  A 
corresponds  to  a natural  maximum  MTF,  i.e.,  distinguished  as 
noticeably  better  because  there  are  no  higher  JND  levels  to 
encompass.  Thio  corresponds  to  the  limit  of  visual  capability. 


Roaall  and  Willson  <1971,  1972,  1974)  and  Hillaon,  Roaall,  and 


Waloalay  (1976)  hava  davalopad  and  lnvaatlgatad  the  signal-to-noiaa 
ratio  at  tha  display  (SNRq) . Equations  describing  tha  SNRq  for 
raotangular  targata  and  parlodlc  targata  hava  baan  producad  and  appliad 
to  obaarvar  taaka  involving  tha  datactlon  of  roetanglaa  or  tri-bar 
pattarna.  Raaulta  from  thaaa  atudlaa  hava  baan  auccaaaful  within  tha 
limits  of  tha  assumptions  mada  in  darlving  tha  SNRq  aquations,  Sinca 
thaaa  afforts  wars  primarily  dlractad  toward  charactarixlng  tha  sanaor 
and  of  tha  display  tyatam,  tha  display  itaalf  was  naglactad.  Tha  SNRq 
aquations  assuma  tha  display  MTF  to  ba  unity.  This  was  not  tha  case  for 
tha  studiaa  undartakan  for  this  dissertation , so  it  was  not  possible  to 
apply  tha  SNRq  concept  without  violating  tha  assumption  under  which  it 
was  derived,  Tha  SNRq  was  intended  primarily  to  characterize  affects 
due  to  noise.  Sinca  this  paper  is  concerned  with  only  low-noise  systems 
and  noiaa  waa  not  a variable  in  the  experiments,  it  is  not  appropriate 
to  try  to  force  tha  SNRq  into  tha  role  of  a display  aystam  FOM. 

Schindler  (1976)  has  proposad  tiu't  information  density  (bits  par 
square  degree),  maaaurad  in  a unique  fashion,  ba  used  as  a display 
system  FOM.  Using  information  theory,  Schindler  derived  an  equation 

i 

for  Information  density > 1 

fF°  r/ps  (f)N1/2  i 

D“J  41o*4(p7TfT)  +lJfdf  (8) 
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where 


F0  * spatial  frequency  of  maximum  useful  information 
f - spatial  frequency  variable  (linear  spatial  frequency) 

Ps  (f)  ■ signal  power  at  frequency  f 

pAs  ) ■ power  of  the  just  discriminable  signal  difference  at 
frequency  f 

Using  a modified  version  of  this  aquation,  Schindler  measured  the 
"information  spectrum"  obtained  from  a film  transparency  by  employing 
optical  Fourier  transform  techniques  and  a special  segmented  detector. 

The  detector  was  located  at  the  Fraunhofer  diffraction  plana  of  the 
optical  Fourier  transform  system.  Xt  contained  32,  semicircular, 
concentric  segments  which  were  used  to  measure  the  power  as  a function 
of  spatial  frequency  in  the  transform  plene.  The  Integral  of  thia 
information  spectrum  (.bite  per  cycle  equarod)  was  calculated  to  obtain 
the  overall  information  dansity. 

A major  problem  with  applying  thia  technique  to  telsvlaion 
displays  1b  that  a photographic  transparency  of  the  display  must  be 
obtained  first  before  the  optically  measured  information  density  can  be 
calculated.  This  intermediate  step  requires  time  for  developing  the 
film  end  contributes  to  the  possibility  of  error.  There  is  also  soms 
problem  in  quantifying  the  relationship  between  exposure  time  end 
dynamic  noise  on  the  display  end  ite  effect  on  the  optically  determined 
information  density.  Also,  the  film  MTF  le  implicitly  assumed  to  be 
unity  for  the  spatial  frequencies  of  interest. 
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In  spite  of  these  concerns,  Schindler  obtelned  good  corrections 
betwsen  the  lnformstion  density  metric  end  performance  variables  for 
several  target  recognition  studies  (r  ■ -0.67;  r » -0.82;  r ■ -0.96). 

Since  the  equipment  was  not  available  to  measure  thc>  information 
density  in  the  same  manner  as  Schindler,  this  FOM  is  not  considered  in 
later  sections  of  this  paper.  However,  it  is  possible  to  use  the 
information  density  approach  of  Schindler  (1976)  and  the  ODD' a of  Carlson 
and  Cohen  (1978)  to  calculate  a FOM  that  can  be  considered  to  be  the 
information  density  capability  of  the  dlaplay/obaarver  system.  From 
Schindler  (1976)  the  information  density  is  defined  to  be: 

fFj{  fFy 

D - 4 log2  {L  <fx,  fy) } dfx  dfy  (9) 

" O ’ 0 

where 

D ■ information  density  in  bits  per  unit  area 
fx  ■ linear  spatial  frequency  in  x direction 
fy  ■ linear  spatial  frequency  in  y direction 
L(fx,  fy)  ■ number  of  discrlmlnable  levels 
Fx  ■ upper  frequency  limit  for  x-axis 
Fy  ■ upper  frequency  limit  for  y-axia 

If  it  is  assumed  that  the  JND  levels  of  Carlson  and  Cohen  can 
be  used  to  replace  L(fx>fy)  in  equation  9,  the  information  density  could 
then  be  calculated  using  equation  10: 


D • 4 


rFx  fpy 

log;,  {JND  (t'x,  fy}  dfx  dfy 

o ' a 

A modified  version  of  this  equation  is  used  in  later  sections  of  this 
dissertation  to  calculate  an  FOM  value  which  is  proportional  to  the 
information  density. 

Another  variation  of  the  area-type  FOM  iB  the  JNDA-log.  This 
FOM  is  calculated  by  determining  the  area  under  the  JND  vs.  log  spatial 
frequency  curve.  Two  lower  limits  of  intergration  for  the  log  spatial 
frequency  were  tried:  one-half  cycle  per  degree  and  two  cycles  per 
degree.  These  are  distinguished  by  a notation  following  the  abbrevia- 
tions, 1/2  cpd  and  2 cpd,  respectively. 

Table  2 shows  a nummary  of  the  FOM 'a  that  are  investigated  in 
this  dissertation.  The  GFP-log  (Task;  and  Verona,  1976)  shown  In  Table  2 
was  calculated  by  integrating  the  gray-ohade  response  curve  with  respect 
to  log  spatial  frequency.  The  log  after  the  abbreviation  Indicates  this 
type  of  integration.  Unfortunately,  integrating  with  respect  to  log 
spatial  frequency  requires  a choice  of  some  arbitrary  low  Bpatial 
frequency  limit  of  integration.  For  the  GFP-log  values  calculated  in 
this  dissertation  the  lower  frequency  cutoff  was  chosen  to  be  one  cycle 
per  degree. 

Two  other  FOM’s  were  investigated  that  are  not  listed  in  Table  2. 
These  represent  minor  modifications  of  the  FOM's  listed  and  are 
explained  in  the  appropriate  sections  of  this  dissertation. 
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Table  2.  Lint  of  FOM's  investigated  and  their  abbreviations 
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Limiting  Resolution 

Lim.  Res. 

I 

Log  Limiting  Resolution 

Log  Lim.  Res. 

i 

i 

Suprathreshold  Resolutiun 

S . T . Res . 

s 

1 

! 

Log  Suprathreshold  Resolution 

Log  S.T.  Rea. 

i 

t 

Modulation  Transfer  Function  Area 

MTFA 

i 

Y 

[ 

Log  Modulation  Transfer  Function  Area 

Log  MTFA 

Equivalent  Bandpass 

Ne 

1. 

f 

l 

i 

t 

1 

j: 

Gray  Shade  Frequency  Product 

GFP 

Gray  Shade  Frequency  Product-Log 

GFP-Log 

? 

I 

Subjective  quality  Factor 

SQF 

1 

Integrated  Contrast  Sensitivity 

ICS 

l 

T 

t 

Just-Noticcable  Difference  Area 

JNDA 

j 

Log  Just-Noticeable  Difference  Area 

Log  JNDA 

/ 

[ 

Information  Density 

Info.  Dena . 

\ 

\ 

Log  Information  Density 

Log  Info,  Dens. 

[ 

Juat-Noticeable  Difference  Area-Log  (1/2  cpd) 

JNDA-Log  (1/2  cpd) 

Just-Noticeable  Difference  Area-Lug  (2  cpd) 

JNDS-Log  (2  cpd) 
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CHAPTER  3 


EVALUATION  OF  DISPLAY  SYSTEM  FIGURES  OF  MERIT 

There  have  been  countless  studies  in  the  past  to  determine  Jhe 
effect  of  several  parameters  on  vision  and  visual  perception.  Likewise 
many  studies  have  been  done  to  assess  the  effect  of  various  display 
parameters  on  visual  performance.  In  order  to  be  useful  an  FOM  must  be 
sensitive  to  both  characteristics  of  vision  and  characteristics  of  the 
display  system.  All  of  the  FOM's  under  consideration  in  this  paper, 

y 

with  the  exception  of  one,  are  affected  by  both  display  and  vision 
characteristics.  The  exception  is  the  equivalent  bandpass,  Nr  (Schade, 
1953). 

On  close  inspection  it  can  be  seen  that  all  of  the  FOM's  under 
consideration  fall  into  two  basic  categories.  Limiting  resolution  and 
suprathreshold  resolution  are  single-number  quantities  (angular  spatial 
frequencies)  which  characterize  the  display/observer  system  for  a single 
spatial  frequency.  The  remaining  FOM's  are  area-type  measures.  That 
is,  each  one  depends  on  the  MTF  of  the  display  system  (or  some  trans- 
formation of  the  MTF)  and  the  human  visual  contrast  threshold  function. 
The  different  variations  of  the  area  measures  are  essentially  attempts 
to  transform  the  axes  into  dimensions  that  are  properly  weighted  in 
terms  of  visual  information  content. 
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The  remainder  of  this  chapter  contains  a discussion  of  each  of 
the  FOM's  and  an  evaluation  of  the  relationship  of  each  FOM  with  known 
characteristics  of  vision  and  displays. 

Equivalent  Bandpass 

This  measure  does  not  include  any  characteristics  of  the  visual 
system.  Therefore,  there  are  several  parameters  that  can  be  changed  in 
the  display/observer  system  that  would  affect  visual  performance  but 
would  not  affect  Ne.  For  example,  performance  is  affected  by  the 
angular  aize  of  the  display  with  respect  to  the  observer  (Martin,  Task, 
Woodruff,  and  Pinkus,  1976)  but  this  parameter  does  not  affect  the  value 
of  Ne.  For  this  reason  it  is  not  expected  that  Ne  will  perform  weLl  as 
a display  system  FOM. 


Limiting  Resolution 

This  FOM  incorporates  characteristics  of  both  the  visual  system 
and  the  display  system  as  indicated  in  Fig.  2.3.  A loss  of  bandwidth  or 
a loss  of  contrast  will  cause  the  contrast  threshold  function  to  inter- 
sect the  MTF  of  the  display  system  at  a lower  spatial  frequency.  Any 
parameter  which  affects  vision  will  cause  a change  to  the  contrast 
threshold  function,  resulting  in  a different  spatial  frequency  for  the 
limiting  resolution.  Parameters  such  as  luminance  level  and  noiaa  lavel 
are  thus  indirectly  incorporated  into  the  limiting  resolution  concept 
by  their  effect  on  the  contrast  threshold  function.  Thsas  effects 
probably  account  for  the  limited  success  and  wide  use  of  thiu  FOM  as  a 
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means  of  characterising  display  quality.  Ona  problam  with  this  FOM  la 
dua  to  tha  ways  In  which  It  can  ha  obtainad.  Tha  limiting  resolution 
valua  obtainad  for  a display  systam  dapands  upon  tha  way  it  la  datar- 
minad  and  upon  tha  obsarvar  making  tha  datarmlnatlun. 

A major  problam  with  this  POM  stains  from  tha  fact  that  it  Is  a 
"limit-type"  maasura.  That  is,  It  provldaa  information  concarnlng  only 
a singla  spatial  frequency  and  this  spatial  frequency  is,  by  definition, 
at  tha  limit  of  vision.  Figure  3.1  shows  tha  MTF  of  two  display  systems 
which  have  identical  limiting  resolution  values,  but  much  different 
contrast  capabilities  at  the  lower  spatial  frequencies.  The  display 
with  tha  upper  MTF  will  appear  to  have  a batter  image  quality  due  to  the 
increased  contrast,  and  if  tha  contrast  diffaranca  is  great  enough,  it 
will  also  parmit  batter  visual  performance.  It  ie  this  type  of  problem 
that  motivated  the  creation  of  tha  suprathrashold  resolution  FOM 
discusBsd  in  the  next  section. 

Suprathrashold  Resolution 

Tha  cuprethreshold  resolution  is  a single  frequency  type  FOM, 
but  it  provides  information  about  the  display/observer  system  in  the 
middle  range  of  apatlal  frequencies  rather  than  in  tha  high  range. 

This  partially  alleviates  tits  problem  depicted  in  Fig.  3.1  concerning 
the  limiting  resolution.  Figure  3,2  ehowa  two  display  ay stems  with 
identical  suprathrashold  resolutions  but  with  different  MTF' a.  Note 
that  tha  display  ayatem  with  the  higher  contrast  must  have  a lower  band- 
width (equivalent  to  a lower  limiting  resolution)  in  order  to  maintain 
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the  same  auprathreshold  resolution.  Thus,  the  suprathreehold  reeolutlon 
acts  as  a fulcrum  point  In  the  trade-off  between  contrast  and  bandwidth. 
If  the  way  In  which  auprathreshold  resolution  was  defined  is  appropriate, 
then  It  should  accurately  describe  the  results  for  studies  where  contrast 
and  bandwidth  are  both  varied. 

For  the  examples  shown  in  Fig.  3.1  and  Fig.  3.2  a Gaussian- 
shaped  MTF  was  assumed.  If  the  shape  of  the  MTF  is  allowed  to  doviata 
drastically  from  Gaussian,,  then  it  is  possible  to  invent  hypothetical 
situations  for  the  auprathreshold  resolution  such  that  the  suprathresh- 
old  resolution  point  would  not  act  as  a propsr  fulcrum  for  trading  off 
bandwidth  and  contrast.  However,  barring  strangoly  shaped  MTF* a,  the 
auprathreshold  resolution  appears  to  have  the  characteristics  for  a 
potentially  useful  FOM. 

Modulation  Transfer  Function  Area 

The  MTFA  is  the  basis  for  a number  of  area-type  FOM's  that  are 
discussed  in  the  following  sections.  The  major  (potential  ) advantage 
of  this  and  the  following  FOM’s  is  that  they  incorporate  the  MTF  of  the 
display  system  and  the  contrast  threshold  function  (CTF)  of  the  observer 
across  all  spatial  frequencies.  However,  in  order  to  be  effective,  the 
area-type  FOM  must  combine  the  display  MTF  and  the  observer  CTF  In  the 
correct  manner  and  with  th*  correct  axes  transformations  to  produce  a 
quantity  that  will  linearly  correlate  with  performance. 


The  MTFA  is  calculated  using  modulation  contrast  on  one  axis  and 
linear  spatial  frequency  on  the  other.  Both  of  these  quantities  are 
probably  nonlinear  with  respect  to  vision.  Typically,  quantities  such 
as  modulation  contrast  and  spatial  frequency  follow  what  is  called  a 
Weber  Law  (Cornswest,  1970,  pp.  83,  84).  The  Weber  Law  states  that  a 
test  stimulus  must  change  by  a certain  percentage  of  the  reference 
stimulus  in  order  for  the  subject  to  distinguish  butwaen  the  test  stimulus 
and  the  rafarence  stimulus.  Studies  have  shown  that  this  law  holds  for 
simple  luminance  targets  (Cornaweet  and  Pinsker,  1965)  and  for  spatial 
frequency  discrimination  ability  (Campbell,  Nachmlas,  and  Jukes, 

1970) . Evidence  from  Carlson  and  Cohen  (1978)  indicates  that  this  is 
also  true  for  the  contrast  of  sine-wave  targets.  In  light  of  this 
information,  one  would  not  expect  the  MTFA  to  be  linear  with  respect  to 
visual  stimulation  and,  therefore,  to  visual  performance.  By  taking  the 
logarithm  of  the  MTFA,  it  may  be  possible  to  partially  compensate  for  the 
fact  that  the  MTFA  axes  do  not  reflect  the  Weber  Law.  Therefore,  it  is 
probable  that  the  MTFA  will  not  correlate  as  well  with  visual  performance 
ae  the  log  MTFA.  This  was  the  result  demonstrated  by  Snyder  (1974a) . 

Gray  Shade  Frequency  Product 

This  measure  was  proposed  in  an  attempt  to  linearize  the 
modulation  contrast  axis  of  the  MTFA  FOM.  If  the  human  visual  system 
reacts  logarithmically  to  luminance  levels  (Cornsweet  and  Pinsker, 

1965),  then  it  is  possible  to  determine  the  number  of  detectable 
luminance  levels  that  are  represented  by  a particular  modulation 
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contraet.  Using  this  typs  of  transformation  (dsscribsd  in  Chapter  2), 
it  la  poasibla  to  covart  modulation  contrast  into  gray  ahadaa.  Tha 
convarsion  usss  /2  as  a critsrion  for  daflning  a gray  ahada.  This  la 
an  "anginaaring"  daflnition  of  gray  shads  and  dots  not  rapvaaant  a trua 
JND  of  lumlnanca.  Howavsr,  tha  rasulting  transformation  la  proportional 
to  what  would  ba  obtainad  if  a diffarant  JND, level  wars  choaan , 

Thla  transformation  should  improva  corralatlona  with  parformanca 
(ovar  MTFA)  only  if  ths  lumlnanca  laval  capability  of  tha  display  la  tha 
characteristic  important  to  vision.  Tha  affact  of  thla  transformation 
is  to  weight  th*  higher  contrast  lava  la  more  haavily  than  lovar  contrast 
levels , as  can  ba  saan  by  the  graph  in  Fig.  2.6.  However,  if  contrast 
is  the  important  parameter  with  respect  to  vision  (which  seams  more 
likely) i than  tha  Weber  Law  indicates  chat  tha  transformation  should  be 
the  logorithm  of  contrast.  This  typo  of  transformation  weights  tha 
lower  contrast  levels  more  heavily  than  the  higher  contrast  levels. 

Since  it  is  necessary  to  linearize  both  axes  with  raapect  to 
vision,  the  GFP-log  is  an  attempt  to  linearise  both  the  contrast  axis 
and  the  spatial  frequency  axis.  Tha  problem  with  converting  tha  spatial 
frequency  axis  (or  the  contrast  axia)  to  a logorithm  before  integrating 
tha  area  is  that  the  lower  limits  of  integration  are  no  longer  aaally 
defined.  Therefore,  some  arbitrary  low  spatial  frequency  cutoff  muet 
be  used.  Since  this  low  frequency  cutoff  can  have  a large  effect  on 
the  FOM  value,  it  Is  difficult  to  determine.  I priori  what  is  optimum. 

For  the  GFP-log  the  value  was  chosen  to  be  one  cycle  pat  degree  as  a 
convenient,  relatively  low,  cutoff  value. 
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Subjective  Quality  Factor 


Tha  8QF  doaa  not  incorporate  any  transformation  on  tha  contraat 
axis.  It  doaa  tr  ana  form  tha  rpatial  frequency  axil  to  natural  logarithm 
and  llmita  tha  intagratlon  to  the  cantral  araa  of  tha  vlaual  contraat 
aanaltlvlty  function.  Tha  limits  of  Intagratlon  ara  from  In  3 to  In  12 
vhara  tha  3 and  12  ara  In  unlta  of  cycles  par  dagraa.  Tha  logarithm 
trana format Ion  makaa  aanae  from  the  atandpolnt  of  tha  Wabar  Law  and  tha 
llmita  of  Integration  ara  a rough  acknowledgment  of  tha  contraat 
thraahold  function.  It  ahould  ba  notad  that  it  might  ba  poaaibla  to 
improva  tha  log  MTFA  FOM  (or  othara)  by  selecting  an  appropriate  apatial 
fraquanoy  bandpaaa  aa  was  dona  for  tha  SQF. 

Intaaratad  Contraat  Sanaitivitv 

Tha  SQF  is  a apaclal  caaa  (and  approximation)  of  tha  ICS.  Tha 
main  difference  between  tha  ICS  and  the  MTFA  ia  their  relative  aenaitivity 
to  changaa  in  tha  CTF.  van  Meeteren  (1973)  argued  that  tha  MTFA  value 
would  change  negligibly  if  tha  CTF  ware  raiaad  (due  to  nolae  or  some 
aimilnr  factor)  from  0.01  to  0.10.  However,  tha  ICS  would  change 
conaldarably  ainca  tha  CTF  la  divided  into  the  dlepiay  MTF  Instead  of 
balng  subtracted,  It  remains  to  ba  seen  whether  or  not  this  difference 
in  aenaitivity  to  changaa  in  the  CTF  improves  correlation  with 
performance. 
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Juet-Noticaabla  Difference  Arg< 

This  FOM  Is  proposed  in  this  disssrtstlon  ss  s possibls  intans  of 
linearising  ths  contrast  axis  of  tha  MTFA  FOM.  Ths  basis  for  tha  JNDA 
is  tha  work  dona  by  Carlson  and  Cohan  (1978)  on  detectable, dif ftrtnca 
diagrams  (DDD's) . Figurs  2.7  in  Chaptar  2 showed  an  example  of  a ODD. 
Tha  JNDA  is  defined  as  tha  area  under  the  KTF  after  it  has  been  trans- 
formed into  JND  levels  using  the  DDD.  If  vision  responds  primarily  to 
contrast  levels,  then  this  transformation  is  more  appropriate  than  the 
OFP.  Note  that  the  effect  of  the  JND  transformation  is  to  weight  the 
lower  contrast  levels  more  heavily  than  the  higher  contrast  levels. 
Figure  3.3  shows  the  JND  data  of  the  DDD  of  Fig.  2.7  regraphed  as  a 
function  of  modulation  contrast. 

Juat-Noticoabla  Differsnce  Araa-Loa 
This  FOM  is  proposed  in  an  effort  to  traneform  both  axes  of  tha 
area-type  FOM  to  quantities  that  are  theoretically  linear  with  respect 
to  vision  based  on  fundamental  vision  studies.  The  JNDA- log  Is  the  same 
as  the  JNDA  except  the  integration  of  the  area  is  with  respect  to  the 
log  of  the  spatial  frequency  as  indicated  by  the  Weber  Law.  Ths  lower 
limit  of  integration  is  arbitrarily  set  at  log  1/2  cpd  as  tha  lowest 
frequency  measured  by  Carlson  and  Cohen  (1978)  and  shown  in  the  DDD  of 
Fig.  2.7. 
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Information  Density 

Information  theory  providaa  a thaoratical  atructura  for  auch 
technical  araaa  aa  computers  and  data  tranamiasion.  Many  studies  have 
investigated  human  decision  processes  and  thought  processes  in  terms  of 
information  theory  (Fitts,  1954 ; Sperling,  1960).  However,  all  of  theaa 
have  bean  extremely  simple  when  compared  to  the  problem  of  quantitatively 
determining  the  useful  or  required  Information  content  of  a pictorial 
image.  The  information  density  approach  suggested  by  Schindler  (1976), 
described  in  Chapter  2,  does  not  aonaider  the  characteristics  of  the 
human  visual  system.  It  is  a measure  only  of  the  display  system.  As 
auch  it  roughly  corresponds  to  the  capability  of  a display  system  to 
present  detail.  It  is  poeslbla  to  increase  the  information  density 
(amount  of  detail)  to  a point  where  an  observer  can  no  longer  resolve 
the  detail  due  to  vision  limitations.  Thus,  a point  la  reached  at  which 
performance  can  no  longer  improve  due  to  vision  limits,  but  the  infor- 
mation density  metric  can  increase  further  as  detail  is  increased.  This 
la  not  a desirable  characteristic  of  an  FOM. 

The  modified  version  of  information  density  presented  in 
Chapter  2 does  not  have  this  shortcoming.  The  JND  levels  approach  sero 
ae  the  angular  spatial  frequency  reaches  vision  limita.  Therefore,  the 
modified  Information  density  ahowa  promise  in  terms  of  a maximum  upper 
limit  that  corresponds  to  the  vision  limit.  However,  there  is  no  funda- 
mental reason  why  one  would  expect  the  information  density  transformation 
of  the  modulation  contrast  axis  to  correlate  wall  with  performance. 
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It  is  very  difficult  to  predict  which  of  tha  FOM's  discussed 
harain  la  hast  in  tiraa  of  correlating  with  parformanca.  Tha  litaratura 
aaarch  did  not  provlda  any  atudiaa  that  had  baan  dona  which  compared  tnora 
than  two  or  thraa  FOM'a,  Almoat  all  atudiaa  wara  concernad  with  deter- 
mining tha  affact  of  aavaral  display  puranatara  on  a slngla  FOM  and  how 
tha  raaulta  correlated  with  parformanca.  Tha  following  chaptara  will 
quantitativaly  compare  all  of  tha  previously  described  FOM'a  in  terms  of 
their  correlation  with  parformanca  for  tha  aama  experiments.  Thla  la 
tha  first  known  attempt  to  critically  compare  several  FOM'a  for  tha 
identical  experimental  conditions. 
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CHAPTER  4 


EXPERIMENTAL  COMPARISON  OF  FOM'S  FOR  TARGET 
DETECTION  AND  TARGET  RECOGNITION  TASKS 

The  experiment  described  in  this  chapter  was  undertaken  to 
provide  a common  basis  of  empirically  comparing  all  of  the  previously 
described  FOM's,  Two  experiments  were  conducted  simultaneously:  one  a 
target  recognition  task  and  the  other  a target  detection  task.  It  was 
expected  that  the  target  recognition  task  would  provide  better  correla- 
tions with  the  FOM's  than  the  target  detection  task  due  to  the  increased 
variability  of  the  target  detection  task. 

Method 

Subjects 

Seventy-two  subjects  were  used  in  the  study  (36  males)  with  ages 
ranging  £rom  18  to  30  years,  All  subjects  were  prescreened  for  corrected 
or  uncorrected  20/20  visual  acuity,  using  the  Armed  Forces  Vision 
Tester . 

Apparatus 

Two  sets  of  equipment  were  used:  one  set  to  generate  the  appro- 
priate display  condition,  and  the  other  to  adjust  and  measure  the  display 
characteristics  (Task  and  Verona,  1976). 
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Figure  4.1  shows  s picture  of  the  apparatus  used  to  generate  the 
stimulus  material.  The  primary  source  of  imagery  was  recorded  on  black 
and  white  16ma  motion  picture  iilm  and  converted  to  video  format  using 
the  apparatus  of  Fig.  4.1.  The  film  was  run  at  24  frames  per  second. 

All  experimental  conditions  were  obtained  using  a standard  525  line, 

60  Ha  field  rate  display  with  2:1  interlace  of  fields.  The  television 
monitor  shown  in  tha  equipment  rack  of  Fig,  4,1  was  used  by  the  experi- 
menter to  score  the  subject’s  responses.  This  monitor  was  not  visible 
to  the  subject.  The  experimenter  had  control  of  an  electronic  cross 
hair  which  was  displayed  on  thia  monitor.  The  cross  hair  was  used  to 
measure  the  diagonal  of  the  target  at  recognition  for  the  target 
recognition  task,  and  the  position  of  the  target  on  the  screen  for  the 
target  detection  task.  The  diagonal  size  of  the  target  was  converted  to 
the  angle  subtended  by  the  target  at  recognition  for  the  recognition 
task.  For  the  target  detection  task  tha  position  of  the  target  on  the 
display  was  converted  to  slant  range  at  detection.  The  slant  range  to 
the  target  is  defined  as  the  direct  distance  from  the  eensor  to  the 
target.  The  term  slant  range  is  used  to  differentiate  it  from  ground 
range,  which  la  the  distance  from  the  target  to  a point  on  the  ground 
directly  below  tha  sensor  (aircraft).  These  calculations  are  described 
in  Appendix  A.  The  subtended  angle  of  the  target  at  recognition  and  the 
slant  rsngs  to  the  target  at  detection  served  as  the  dependent  variables 
for  the  target  recognition  task  end  the  target  detection  task,  respectively. 

The  display  quality  conditions  for  this  study  were  obtained 
using  all  combinations  of  three  levels  of  contrast  ratio  and  three  video 
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Fig.  4.1.  Equipment  used  to  generate  the  video  atimulua  material 


Fig.  4.2.  The  MTFa  for  the  nine  dlaplay  ayacem  condltiona 


bandwidth#  for  a total  of  nine  conditions.  The  contrast  ratio  la  dafinad 
as  the  ratio  of  tha  maximum  display  luminance  to  tha  minimum  display 
luminance.  The  contrast  ratio  levnln  ware  obtained  by  adjusting  tha 
brightness  and  contrast  controls  of  the  subjects'  monitor,  and.  tha  band- 
widths  ware  obtained  using  a passive,  low  pass,  variable  filter. 

Figure  4,2  shows  tha  resulting  display  system  MTF's  determined  for  theee 
nine  conditions. 

The  display  system  MTF's  were  calculated  by  multiplying  together 
the  measured  MTF's  of  the  film,  the  telavieion  camera,  and  the  talavieion 
monitor.  It  ahould  be  noted  that  tha  eystem  MTF's  calculated  in  this 
fashion  represent  an  approximation  to  the  actual  system  response,  In  a 
rigorous  mathematical  sense,  tha  MTF  is  not  defined  for  any  of  theee 
three  components  (film,  camera,  and  display)  since  each  of  theee  is 
nonlinear.  However,  the  concept  of  a transfer  function  is  sufficiently 
useful  to  warrant  its  use  even  when  a eystem  departs  somewhat  from 
linearity.  This  departure  means  that  a sine-wave  pattern  output  will 
not  be  obtained  If  a sitie-wave  pattern  iu  provided  ao  an  input  to  a 
nonlinear  system.  If  the  nonlinearity  is  relatively  small  and  well 
behaved  (gradual  curvature) , tha  output  still  bears  a reasonable 
resemblance  to  a sine-wave  pattern.  Thus  the  transfer  function  la  not 
really  an  MTF  but  it  serves  the  same  function. 

A problem  can  arise  if  one  attempts  to  multiply  a number  of 
these  "nonlinear  MTF's"  together  without  regard  to  the  severity  or 
direction  of  the  nonlinearities,  In  the  csee  of  the  TV  camera  and  the 
monitor,  the  nonlinearity  (or  gamma)  is  in  the  opposite  direction  with 
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respect  to  each  other.  In  fact,  the  coupling  of  the  camera  and  monitor 
almost  perfectly  compensates  for  the  nonlinearity,  resulting  in  an 
almost  linear  camera/display  system.  The  film  gamma  was  measured  to  be 

$ 

approximately  one  by  the  organisation  that  processed  and  printed  the 
film.  Thus  the  display  system  was  clo?e  to  linear. 

To  insure  that  minimum  error  was  introduced  by  multiplying  the 
TV  camera  and  monitor  MTF's  together,  a short  experiment  was  done.  The 
camera/monitor  system  square-wave  response  was  measured  directly  using 
a set  of  square-wave  targets  and  a scanning  photometer.  This  was  con- 
verted to  a sine-wave  response,  then  compared  to  the  MTF  that  was 
obtained  by  multiplying  the  camera  MTF  times  the  display  MTF.  The  two 
curves  were  close,  indicating  that  a relatively  small  error  resulted 
from  the  MTF  component  multiplication  method;  thus  justifying  this 
approach  for  the  system  used.  Figure  4.3  shows  these  two  curves. 

The  film  MTF  was  determined  by  making  mlcrodansitometer  scans  of 
high  contrast  edges  and  converting  these  data  to  An  MTF  using  Fourier 
techniques.  The  actual  microdensitometer  scans  and  MTF  calculations  were 
done  by  the  Dynamics  and  Environmental  Evaluation  Branch,  Reconnaissance 
and  Weapon  Delivery  Division  of  the  Air  Force  Avionics  Laboratory  at 
Wright-Patterson  Air  Force  Base,  Ohio.  The  resulting  MTF  was  sufficiently 
close  to  Gaussian  in  shape  that  a Gaussian  approximation  to  the  MTF  was 
used  for  convenience  of  calculations.  The  technique  used  for  calculating 
the  MTF  from  an  edge  acan  can  be  found  in  Gasklll  (1978).  The  camera 
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spatial  pmqukncy 

(CYCLH/AASTM  WIDTH) 


Fig,  4,3.  Comparison  botwosn  a system  MTF  calculated  by 
multiplying  the  comporent  MTF' ■ together  and  a 
ayatem  MTF  measured  directly 

The  solid  line  was  obtained  by  multiplying  the  directly 
measured  television  display  MTF  times  the  television  camera 
MTF.  The  TV  camera  MTF  was  determined  by  directly  measuring 
the  square-wave  amplitude  response  and  converting  it  to  a 
sine-wav«  response.  The  dotted  line  was  obtained  by 
measuring  the  total  system  square-wave  response  and  then 
converting  it  to  a sine-wave  response. 


MTF  wii  measured  by  observing  tha  electronic  aignal  araplituda  output,  on 
an  oscilloscope,  aa  a function  of  tha  apatlal  frequency  of  aquara-wava 
targets  imagad  onto  tha  photo  surface,  Thla  aquara-wava  raaponaa  waa 
than  convartad  to  a aina-wava  raaponaa  (Brown,  Collina,  and  Hawkina, 
1969).  Tha  ealavlaion  diaplay  waa  maaautad  uaing  a aignal  ganarator 
which  producad  a aina-wava  alactronic  aignal  in  vidao  format.  Thia 
aignal  waa  adjusted  to  hava  tha  aama  maximum  and  minimum  aignal  lavala 
aa  tha  talavlaion  camara,  Tha  aignal  waa  input  to  tha  talavialon 
monitor,  and  tha  raaulting  aina-wava  pattarn  on  tha  diaplay  waa  acannad 
uaing  a talaphotomatar  with  a allt  apartura  aa  ahown  in  Fig.  4.4.  By 
rapaating  thia  procadura  aa  a function  of  apatial  fraquancy,  tha  MTF  of 
tha  talavialon  diaplay  waa  maaaurad.  Tha  product  of  thaaa  waa  than 
calculatad  for  aach  of  tha  nina  diaplay  condltlona  to  datarmina  tha 
ovarall  MTF  of  tha  diaplay  aystam  for  aach  condition. 

Tha  thraa  lavala  of  bandwidth  uaad  wara  6 MHc,  1.0  MHs,  and 
0.4  MHc  (maaaurad  at  tha  3 dB  point)  and  tha  thraa  contract  ratio  lavala 
wara  50:1,  30:5  and  50:13.  Tha  contract  ratio  numbara  rapraaant  tha 
maximum  and  minimum  diaplay  luminance  valuaa  (in  foot-Lambarta)  for  a 
low  spatial  fraquancy  (6  cyclaa/diaplay  width)  aquara-wava  pattarn. 

Appendix  B provides  a Hat  of  tha  equipment  uaad,  tha  modal 
numbara  and  tha  manufacturara. 

Stimulus  Material 

Tha  16mm  motion  picture  film  uaad  for  tha  target  recognition 
tack  was  producad  in  tha  following  mannar.  Eight  inch  by  tan  inch  black 
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and  whlce  prints  were  made  of  six  raodals  of  vahicla  targets  (see 
Fig.  4.5).  Each  of  tha  targata  was  photographed  in  each  of  four 
orientations  for  a total  of  24  target  conditions.  Tha  targets  ware: 
covered  truck,  uncovered  truck,  M-60  tank,  Sherman  tank,  mobile  cannon 
and  half-track.  Each  of  tha  8 x 10  prints  was  affixed  to  tha  canter  of 
a large  gray  backdrop.  A 16mm  motion  picture  camera  with  a motorised 
zoom  lens  was  then  used  to  make  a "room- in"  film  of  the  target.  The 
zoom  sequence  was  about  20  seconds  in  duration  for  a 10  to  1 magnifica- 
tion change.  This  zoom  sequence  was  done  for  each  of  the  24  target 
situations.  When  presented  to  the  subject,  the  target  first  appeared  in 
the  center  of  the  display  for  2 to  3 seconds,  then  slowly  increased  in 
size  until  the  subject  could  recognize  which  of  the  six  targets  it  was. 

For  the  target  detection  task  the  16mm  film  imagery  consisted  of 
"flights"  over  a terrain  board  at  simulated  altitudes  of  1000  and  2000 
feet.  The  targets  were  prebrief sd  bridges  and  POL  (petroleum,  oil, 
and  lubricant)  Btorage  tanks.  Figure  4.6  shows  a bridge  target  and 
Fig.  4.7  shows  a POL  target  at  relatively  close  range.  A total  of  40 
"flights"  over  targets  were  presented  to  each  subject. 

Procedure 

Each  morning  before  subjects  arrived  and  each  afternoon  after 
subjects  were  run,  the  MTF  of  the  display  monitor  was  measured  and  the 
signal  levels  from  the  television  camera  were  recorded.  This  insured 
that  the  display  quality  remained  constant  for  the  duration  of  each 
experimental  display  condition. 


Subjects  were  checked  for  20/20  vision  and  given  written 
Instructions  explaining  thoir  task.  Any  questions  were  then  answered  by 
the  experimenter.  Briefing  materials  included  photographs  of  the  targets 
and i for  the  target  recognition  task,  the  target  models.  Subjects  were 
trained  so  that  they  could  respond  rapidly  with  the  correct  name  of  each 
of  the  six  targets.  All  subjects  completed  the  target  recognition  study 
first.  They  were  then  instructed  about  the  target  detection  study  and 
completed  that  oeeond.  A break  period  was  provided  betwean  the  two 
studies  and  at  the  midpoint  of  each  study. 

For  the  tnrgut  recognition  study,  the  target  appeared  in  the 
center  of  the  display  and  grew  in  siao  until  the  subject  was  "virtually 
curtain"  of  the  name  of  the  target.  At  thiH  point  the  subject  pressed 
a handheld  button.  Thie  action  stopped  the  I6mm  film  projuctor  mid 
blanked  the  display  to  prevent  the  subject  from  further  studying  the 
target.  The  blanked  screen  was  set  to  have  approximately  the  sumo 
average  luminance  as  the  displayed  Imagery  to  prevent  changes  In  eye 
luminance  adaptation  level.  Immediately  after  the  subject  preuaeU  the 
button  he  responded  with  the  target  noma.  The  experimenter,  observing 
his  monitor,  recorded  the  response  and  measured  the  diagonal  of  the 
target.  This  sequence  was  then  repeated  for  the  next  target.  Thu  24 
targets  were  presented  in  s random  order  and  were  shown  to  each  subject 
twice  for  a total  of  48  target  runs, 

The  procedure  for  the  target  detection  tShk  was  slightly 

different.  Subjects  were  told  before  ouch  target  run  which  target  they 
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were  searching  for:  bridge  or  POL.  The  target  was  not  initially  visible 
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on  tha  display.  Ad.  the  "flight"  prograaaad  tha'  targat  would  appaar  on 
the  display.  Tha  "flight"  paths  wavs  arrangad  so  that  tha  targat  would 
appaar  on  tha  cantar  llna  of  travsl,  off  to  tha  laft  or  off  to  tha 
right*  Whan  the  sub j act  detected  tha  targat  ha  pressed  tha  handheld 
button  which  immediately  stopped  tha  16mm  projector.  Tha  display  was 
not  blanked  but  remained  on  ao  that  tha  subject  could  point  to  tha 
location  of  tha  target.  Tha  experimenter  than  used  tha  electronic 
cross  hair  to  determine  tha  x,  y coordinates  of  tha  target  on  the  screen, 
These  data  were  tb**:.  used  to  calculate  tha  simulated  elant  range  to  the 
target  at  detection  (see  Appendix  A). 

The  entire  procedure  for  both  studies,  Including  raat  breaks . 
required  approximately  three  hours  per  subject. 
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Results 

Table  3 summarise!  the  results  of  tha  targat  recognition  study. 


Table  3.  Mean  angle  subtended  by  the  target  at  recognition  (in 
degrees)  for  the  target  recognition  study 


Contrast  ratio 

6 MHz 

Bandwidth 

1.0  MHz 

0,4  MHz 

50 1 X 

1.5  deg 

2. A deg 

3,4  deg 

50:5 

1 .6  deg 

1.9  deg 

3.6  deg 

50:15 

1.9  deg 

2,2  deg 

3.9  deg  i 

t 
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Etch  number  listed  In  Table  3 represents  the  average  of  approximately 
384  data  pointa  (tight  subjects  par  condition  timaa  48  target  rune  par 
aubjact).  8ome  data  pointa  vara  mieaing  due  to  subject  errors  in 
identifying  the  targets.  These  pointa  were  rsplacad  with  the  average 
value  for  the  display  condition  in  which  thay  occurred.  Table  4 shows  a 
summary  of  the  analysis  of  variance  done  on  the  target  recognition 
performance  results.  It  la  apparent  from  this  table  that  bandwidth  had 
a much  greatar  effect  on  performance  than  contrast  ratio.  Table  5 
shows  the  average  percent  correct  responses  for  each  of  the  nine  display 
conditions.  The  percent  correct  response  was  approximately  the  same 
for  all  condltiona  with  the  exception  of  two  of  the  lowest  quality 
conditional  30 <5  and  50il3  at  0.4  MHe  bandwidth.  The  instructions  to 
the  subject  were  intended  to  motivate  the  subject  to  recognise  the  target 
as  soon  as  possible  but  with  a minimum  error.  The  subject  was  instructed 
to  respond  as  soon  as  he  was  "virtually  certain"  of  the  correctness  of 
his  response.  In  previous  studies  (Martin  at  al.,  1976)  this  provided 
a satisfactorily  low  error  rate  and  reasonably  uniform  percent  correct 
response  rates  across  the  experimental  conditions.  With  the  exceptions 
noted  above , this  technique  appeared  to  work  reasonably  well  for  this 
target  recognition  study.  The  performance  analysis  is  based  on  the 
angle  subtended  by  the  target  at  recognition  as  the  performance  variable 
of  interest.  Table  6 is  a summary  of  the  analysis  of  variance  performed 
on  the  percent  correct  response  data. 
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Tabic  4.  Analytic  of  variance  sutmnary  for  the  target  recognition 
performance  tack* 


Source 

Ss 

DF 

MS 

F 

P 

Contrast  ratio 

1.1291 

2 

0.5645 

3.1 

0.05 

Bandwidth 

50.9949 

2 

25.4975 

140.4 

<0.001 

A x B 

1.2917 

4 

0.3229 

1.8 

0.14 

Within  cell 

11.4362 

63 

0.1815 

Total  (check) 

64.8519 

71 

0.9134 

*A  summary  of  tha  analycis  of  variance  ie  provided  for  each 
performance  taek.  The  format  for  each  of  theca  ie  the  came  ae  that  ehovm 
in  Table  4.  Tha  SOURCE  column  of  Table  4 Indicates  the  item  analyzed  in 
each  row.  SS  stande  for  eum  of  squares,  DF  for  degrees  of  freedom,  MS 
for  mean  square,  F is  the  F-test  number,  and  the  p ie  the  probability 
aeeoclated  with  accepting  the  null  hypothesis  (i.e.,  no  difference  in 
performance  due  to  changes  in  the  variable  shown  in  the  SOURCE  column). 

A x B is  the  interaction  of  contrast  ratio  and  bandwidth.  The  within 
cell  SS  value  indicates  the  amount  of  unaccounted  for  variance.  The 
total  SS  value  was  calculated  independently  of  the  other  SS  values  as  a 
check;  the  total  value  should  be  the  same  as  the  sum  of  tin1  other  SS 
values. 
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Table  5.  Percent  correct  reeponee  for  uhe  nine  display  conditions  of 
the  target  recognition  task 


Contrast  ratio 

6 MHz 

Bandwidth 

1.0  MHz 

0.4  MHz 

50:1 

90.4 

89.1 

88.8 

50:5 

90.4 

90.6 

82.0 

50:15 

93.2 

89.8 

79.4 

Table  6.  Analysis 
data  of 

of  variance  summary  for  the  percent  correct 
the  target  recognition  study 

response 

Source 

SS 

DF 

MS 

F 

P 

Contrast  ratio 

61.4444 

2 

30.7222 

0.7745 

0.465 

Bandwidth 

798.7778 

2 

399.3889 

10.0686 

<0.001 

A x b 

370.5556 

4 

92.6389 

2.3354 

0.065 

Within  cell 

2499.0000 

63 

39.6667 

Total  (check) 

3729.7778 

71 

52.5321 

ij 
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Tabic  7 shows  Che  calculated  values  of  ths  different  FOM's  for 
the  nine  display  conditions.  The  values  of  the  performance  variable 
were  correlated  with  the  calculated  values  of  each  FOM  for  each  condition. 
Table  8 shows  the  correlation  between  performance  and  the  various  FOM's. 
Appendix  C contains  the  graphs  of  these  correlations. 
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After  inspecting  th*  graph*  of  th*  correlation*  and  comparing  th* 
reoulta  with  th«  MTF'a  of  th«  nina  diaplay  condition*,  it  btcam*  avidant 
that  higher  correlation*  may  b*  obtained  by  calculating  the  MTFA  for  a 
limited  spatial  frequency  band.  The  argument*  for  doing  thia  are  similar 
to  thoae  that  led  to  the  band  limit  for  the  SQF  FOM.  Two  variation*  of 
the  MTFA  were  tried.  On*  variation  involved  changing  the  upper  apatlal 
frequency  limit  of  th*  MTFA  to  the  aine-wave/aquare-wav*  Jiacrlmination 
curve  inatuad  of  uaing  th*  *in«-w*v*  threshold  curve.  Thia  eliminate* 
the  urea  of  the  MTFA  aaaociatad  with  the  higher  vieual  apatlal 
frequenciea.  Since  th*  aine-wav*  threshold  uaed  for  the  MTFA  calculation* 
repreaanted  a SO  percent  detection  probability!  it  can  be  argued  that  the 
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MTFA  nearest  this  curve  contributed  relatively  little  to  the  visual 
information  assimilated  by  the  subject*  The  sine-wave/ square-wave 
discrimination  curve  provides  u convenient , more  consorvative  upper 
limit  on  the  spatial  frequencies  useful  for  ths  transfer  of  visual 
information. 

the  second  variation  Included  the  above  modification  and  also 
removed  the  very  low  spatial  frequency  portion  of  tha  MTFA.  Ths  SQF  uses 
3 cpd  as  Che  lower  cutoff.  Since  the  peak  sensitivity  of  ths  visual 
system  la  somewhere  between  3 cpd  and  6 cpd,  it  was  dec-ded  to  iowor  ths 
cutoff  to  2 cpd  to  insure  that  those  spatial  frequences  associated  with 
peak  visual  sensitivity  were  Included, 

The  first'  variation  is  denoted  the  SSMTFA,  indicating  that  it  la 
calculated  using  the  sine-wave/ square-wave  discrimination  curve  as  an 
upper  limit;  and  tha  second  variation  is  denoted  as  the  BLMTFA  for  band 
limited  MTFA.  Table  9 shows  the  correlations  of  the  logarithms  cf  these 
new  FOM's  with  performance  for  the  target  recognition  study, 

Table  9.  Correlation  between  the  modified  MTFA  FOM's  and  turget 
recognition  performance 


FOM 


Correlation 


Xha  tog  BLMTFA  products  an  excellent  correlation  with  performance. 
However,  one  must  be  careful  when  searching  for  quantities  that  correlate 
well  with  performance  after  the  experiment  is  completed.  Given  enough 
degrees  of  freedom  in  creating  an  FOM,  it  iff  possible  to  achieve  a perfect 
unity  correlation  with  performance  for  a particular  set  of  data.  Tha 
raal  teat  of  these  modified  MTFA  FOM* a is  in  the  later  sections  of  thia 
dlaaertation  where  tuey  are  compared  to  performance  data  obtained 
independently  from  this  target  recognition  study. 

The  target  detection  study  performance  analysis  wae  limited  to 
the  slant  range  at  which  the  POL  target*  wets  detected,  the  data  for  the 
bridge  targets  contained  too  many  missed  targatu  to  use  ulant  range  aa  a 
performance  variable,  Th*  POL  target  runs  were  divided  Into  two  groups: 
thoaa  at  1000  feet  altitude  and  those  at  2000  feet.  This  was  necessary 
because  of  tha  large  differences  in  slant  range  for  these  two  conditions. 
Table  10  shows  a summary  of  tha  slant  range  performance  for  the  nine 
display  conditions  and  two  altitudes. 

Tublea  11  and  12  show  the  anulysia  of  variance  summary  fur  the 
1000  feet  and  2000  feet  altitude,  respectively. 
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Tabla  11.  Analysis  of  varlanos  summary  for  eha  eargat  datactlon 
slant  ranga  data  at  1000  fast  altituds 


Souros 


Tabla  12.  Analysis  of  varlanos  summary  for  tha  targat  datactlon 
slant  ranga  data  at  2000  fast  altituds 


s 

\ Contrast  ratio 

4,215,100 

2 2,107,550 

Bandwidth 

40,235,942 

2 20,117,971 

Total 


85,699,812  71 


r 
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Uilng  ths  slant  rsngs  as  ths  performance  variable)  correlations 
were  calculated  for  the  19  FOM's  for  both  1000  and  2000  feet.  Table  13 
shows  these  results.  The  correlation  graphs  are  contained  in  Appendix  C. 

Note  that  the  correlations  in  Table  6 are  negative  and  the 
correlations  of  Table  13  are  positive.  This  occurs  because,  for  the 
target  recognition  study  of  Table  8,  the  smaller  the  target,  the 
better  the  performance,  whereas,  for  the  target  detection  study,  longer 
slant  ranges  represent  better  performance. 

Discussion 

Tables  8,  9,  and  13  summarise  the  main  results  of  these  target 
recognition  and  target  detection  studies.  All  of  the  FOM's  investi- 
gated correlated  reasonably  well  with  performance  for  all  three  task 
conditions.  Correlations  ranged  from  a high  of  |r|  - 0.948  to  a low 
of  | r | » 0.618.  Table  14  Indicates  the  rank  order  of  the  performance 
correlation  for  each  of  the  19  FOM's  for  the  three  tasks.  It  should  bo 
noted  that  the  three  observer  tasks  are  not  independent  in  the  sense 
that  the  nine  display  conditions  for  all  three  were  identical.  Even 
with  this  cautionary  note,  the  consistency  of  the  rank  ordering  of  the 
FOM's  across  the  three  tasks  is  surprising. 
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Table  13.  Correlations  of  FOM'a  with  POL  target  detection  performance 


FOM 

1000  ft  alt 

2000  ft  alt 

N. 

0.761 

0.618 

Lim  Res 

0.778 

0.695 

Log  Lim  Res 

0.795 

0.709 

S.T.  Rea 

0.900 

0.834 

Log  S.T.  Res 

0.923 

0.864 

MTFA 

0.829 

0.717 

Log  MTFA 

0.866 

0.777 

GFP 

0.798 

0.670 

GFP-Log 

0.869 

0.760 

SQF 

0.803 

0.702 

ICS 

0.837 

0,724 

JNDA 

0.880 

0.802 

Log  JNDA 

0.902 

0.838 

Info  Dene 

0.824 

0.766 

Log  Info  Dens 

0.880 

0.842 

JNDA-Log  (1/2  cpd) 

0.928 

0.853 

JNDA-Log  (2  cpd) 

0.902 

0.835 

Log  SSMTFA 

0.857 

0.762 

Log  BLMTFA 

0.931 

0.878 

IS 


Table  14.  POM' a rank  ordered  according  to  thalr  correlation  with 
parfornance  Cor  tha  target  recognition  task  end  the  two 
target  detection  condltiona 


FOH 

Target  Recognition 

POL  1000  ft 

POL  2000  ft 

Log  BLMTFA 

1 

1 

1 

JNDA-Log  (1/2  cpd) 

2 

2 

3 

Log  S.T.  Rea 

3 

3 

2 

Log  JNDA 

4 

4 

5 

JNDA-Log  (2  cpd) 

3 

5 

6 

S.T.  Rea 

6 

6 

7 

Log  MTFA 

“* 

i 

10 

9 

JNDA 

8 

8 

8 

Log  SSMTFA 

9 

11 

11 

QFP-Log 

10 

9 

12 

Log  Info  Dene 

11 

7 

4 

ICS 

12 

12 

13 

MTFA 

13 

12 

14 

Info  Dena 

14 

14 

10 

Log  Lim  Rea 

15 

17 

15 

SQF 

16 

15 

16 

CFP 

17 

16 

18 

I.im  Rea 

18 

18 

17 

Ne 

19 

19 

19 

N 


It  is  apparent  from  th«  relatively  poor  showing  of.  tha  limiting 
resolution  that  this  quantity  doaa  not  aarva  wall  aa  a display  ayatam 
FOM.  Limiting  raaolution  might  ba  a raasonabla  paramstar  to  uaa  in 
conjunction  with  other  parametera  to  roughly  daacriba  a talavlaion 
dlaplay  system,  but  it  doaa  not  provide  a vary  good  maana  of  Indicating 
overall  dlaplay  image  quality.  Tha  equivalent  bandpass  of  Schada  alao 
fella  in  thia  category,  based  on  its  rank  order  in  Table  14. 

The  log  BLMTFA  ranked  highest  for  all  three  observer  teaks, 
followed  closely  by  tha  JNDA-log  (1/2  cpd),  It  ia  impossible  to  declare 
either  of  these  aa  clearly  superior  to  the  other  since  their  correla- 
tions with  performance  are  ao  cloae.  It  la  interesting  that  both  are 
area-type  measures,  although  the  next  ranked  FOM  ia  the  log  suprathras- 
hold  resolution  which  is  not  an  area-type  measure. 

The  failure  of  the  gray-shada  transformation  to  improve  the 
area-type  FOM  over  the  MT7A  and  the  JNDA  indicates  that  the  gray-ahade 
concept  ie  not  appropriate  as  a useful  display  describing  parameter. 

The  work  on  DDD'a  by  Carlson  and  Cohan  (1978)  and  the  results  shown  in 
Table  14  provide  e strong  indication  that  the  grey-shade  capability  of 
a display  system  ie  not  a characteristic  that  relates  well  to 
performance. 
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CHAPTER  S 


APPLICATION  OF  FIGURES  OF  MERIT  TO  A PREVIOUS  DISPLAY  STUDY 

The  problem  with  applying  FOM'a  to  a previously  completed  at:udy 
la  to  obtain  sufficient  information  concerning  the  display  conditions  to 
calculate  the  value  of  the  FOM'a.  Since  the  author  wee  Involved  with 
the  study  done  by  Martin  et  *1.  (1976).  sufficient  data  were  available 
to  calculate  the  FOM’s. 

The  purpose  of  the  uxperlment  was  to  determine  the  effect  of 
element  density  (numbsr  of  display  elements  per  degree  visual  angle) 
and  active-to-total*-area  ratios  on  target  recognition  performance.  The 
same  16mm  motion  picture  imagery  described  in  Chapter  4 was  projected 
onto  a rer.r  projection  screen  for  viewing  by  the  subjects.  In  the  pilot 
study,  six  viewing  distances  vreru  used  corresponding  to  six  different 
display  element  density  levels.  Thu  different  actlve-to-total-area 
ratios  were  simulated  by  piecing  a grid  mask  over  the  rear  projection 
screen.  The  line  width  of  the  grid  meek  was  varied  to  achieve  four 
values  of  active-to-total-area  ratios.  The  results  indlcsted  no 
performance  differences  due  to  ective-to-total-arse  ratioa  so  ths 
viewing  distance  data  presented  in  this  chapter  is  an  average  across 
this  parameter. 
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Th«  six  viewing  distances  correspond  to  six  angular  MTP’s  «t  the 
displayed  luge.  Figure  3.1  shows  these  six  angular  NTF's  graphed  with 
the  nine  display  system  MTF's  of  Chapter  4 for  comparison.  The  two 
vlnual  threshold  curves  of  Campbell  and  Robson  (1968)  described  previ- 
ously are  also  shown. 


(CVCLES/OEQREt) 


Fig.  5.1.  The  six  angular  MTF'a  (right)  corresponding  to  the  six 
viewing  distances  of  the  film  display  study 

The  nine  MTF's  of  the  study  described  in  Chapter  4 (left) 
and  the  two  visual  threshold  curves  of  Campbell  and 
Robson  (1968)  are  shown  for  reference. 
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The  subjects  for  this  experiment  wara  trained  for  aavaral  weeks 
prior  to  participating  in  tha  experiment.  Ail  subjects  vara  brought  to 
an  asymptotic  level  of  performance  to  preclude  learning  effects.  All 
conditions  were  presented  to  all  subjects.  Table  15  shews  a summary  of 
the  performance  results  of  the  study.  The  performance  variable  was 
the  same  as  that  used  for  the  study  of  Chapter  4,  namely,  the  angle 
subtended  by  the  target  at  recognition.  An  analysis  of  variance  was  not 
published  for  these  data  in  tha  report  from  which  they  were  obtained. 


Table  15.  Target  recognition  performance  for  different  viewing 
distances 


Viewing  Distance 
(meters) 


Angle  Subtended  by  the  Target 
at  Recognition  (deg) 


iW 


Tabic  16  shows  the  calculated  value  of  the  FOM'a  for  tha  six 
viewing  distances  of  this  experiment.  The  Gaussian  film  MTF'a  shown  In 
Figure  5.1  were  used  to  calculate  the  FOM  values.  It  should  be  noted 
that  these  MTF's  only  approximate  the  actual  display  MTF  for  this  study. 
Stray  light  and  ambient  room  illuminance  would  tend  to  lower  the  MTF 
at  the  lower  spatial  frequencies.  This  display  was  not  available  to 
measure  the  actual  MTF  as  it  was  projected.  This  approximation  (using 
the  Gaussian  film  MTF  to  be  the  same  as  the  projected  display  MTF)  is 
reasonable  for  all  of  the  FOM's  except  one.  Tha  value  of  the  GFP  is 
very  sensitive  to  small  changes  in  the  modulation  level  at  high 
modulation  levels.  Since  there  is  an  uncertainty  as  to  the  exact 
upper  modulation  level  of  the  projected  image,  it  was  decided  to  eliminate 
the  GFP  calculation  from  the  list  of  FOM's  for  this  study. 

Table  13  shows  the  correlation  between  tha  FOM  values  and  the 
performance  variable  of  this  study. 

The  most  startling  aspect  of  Table  17  in  that  almost  all  of  the 
FOM's  correlate  aighly  (0.90  or  better)  with  performance.  In  this 
respect  the  information  in  Table  17  does  not  provide  any  further  inaight 
into  the  question  of  which  FOM  is  the  beet  correlate  of  performance. 
However,  the  two  FOM's  that  were  ranked  highest  in  Chapter  4 correlated 
very  highly  with  performance  (-0.977  and  -0.903),  indicating  that  thaae 
two  are  atill  the  moat  promising  FOM'a. 


71 


Table  16. 

Calculated  valuaa 
distances 

of  18  FOM 

I'e  for  the  six  display  viewing 

4.37 

Viewing  Diatanca 
2.91  2.18 

(Maters) 

1.46 

1.09 

j 

0.73  | 

Theoret- 

iral 

Maw. 

V 

67.5 

44.6 

33.7 

22.5 

17.0 

11.3 

CO 

Lin  Res 

51 

45 

41 

35 

31 

27 

61 

Log 

1.71 

1.65 

1.61 

1.54 

1.49 

1.43 

1.78 

Llm  Res 

S.T.  Rea 

11.1 

11.0 

11.0 

10.8 

10.6 

10.2 

11.25 

Log 

1.045 

1.041 

1.041 

1.033 

1.025 

1.009 

1.051 

S.T.  Res 

MTFA 

35.0 

31.8 

28.8 

23.8 

20.1 

14.9 

40.8 

Log 

1.55 

1.50 

1.46 

1.38 

1.30 

1.17 

1.61 

MTFA 

GFP- 

29.2 

25.3 

22.6 

18.9 

16.4 

13.1 

09 

Log 

SQF 

0.5995 

0.5964 

0.5920 

0.5799 

0.5635 

0.5207 

0.602 

ICS 

4381 

4332 

4272 

4124 

3951 

3566 

4637 

JNDA 

845 

845 

827 

782 

737 

642 

867 

Log 

2.927 

2.927 

2.918 

2.893 

.■» . 867 

2.808 

2.938 

JNDA 

Info  Dana 

111.0 

111.0 

110.2 

107.3 

104.9 

94.1 

111.9 

Log  Info 

2.045 

2.045 

2.042 

2.033 

2.020 

1.974 

2.049 

Dana 

JNDA-Log 

73.72 

73.72 

73.42 

72.51 

71.61 

69.50 

74.32 

1/2  cpd 

JNDA- Log 

2 

40.97 

40.97 

40.57 

39.76 

38. 86 

36.75 

41.76 
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Table  16.  Continued 


4.37 

Viewing  Distance  (Meters) 

2.91  2.18  1.46  1.09 

0.73 

| Theoret- 
ical 

1 Max 

Leg 

SSMTFA 

0,061 

0.958 

0.955 

0.947 

0.936 

0.907 

0.966 

Log 

BLMTFA 

0.854 

0.850 

0.846 

0.835 

0.821 

0.783 

0.862 

A 

In  the  original  definition  of  N , there  would  be  no  change  In  this 
parameter  due  to  viewing  distance  of  the  observer  since  the  measure 
was  k characteristic  of  the  display  only.  The  values  shown  here  were 
obtained  by  converting  the  linear  equivalent  bandpass  spatial 
frequency  to  an  angular  spatial  frequency  equivalent  bandpass  value. 
These  Values  do  change  with  observer  viewing  distance. 
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Table  17.  Corral at ion a between  tha  TOM' a and  target  recognition 
performance  for  the  film  study  of  Martin  at  al.  (1976) 


rciM 

Correlation 

Log  BLMTFA 

-0.977 

4 JNDA-Log  (1/2  cpd) 

-0.983 

Log  S.T.  Res 

-0.969 

Log  JNDA 

-0.984 

JNDA-Log  (2  cpd) 

-0.983 

S.T.  Rea 

-0.973 

Log  MTFA 

-0.950 

JNDA 

-0.983 

Log  SSMTFA 

-0.978 

GFP-Log 

-0.858 

Log  Info  Dens 

-0.971 

ICS 

-0.978 

MTFA 

-0.912 

Info  Dene 

-0.974 

Log  Llm  Res 

-0.885 

SQF 

-0.979 

GFP 

— 

Llm  Res 

-0.851 

Ne 

-0.729 

Thor*  are  aajor  dlffarencaa  between  tha  atudlea  of  Chaptar  4 
and  tha  study  daacrlbad  in  this  chaptar  that  ara  probably  raaponaibla 
for  tha  high  correlations.  Tha  moat  significant  difference  la  that  the 
film  study  varied  only  one  parameter f i.e.,  viewing  distance  (angular 
MTF),  whereas  tha  atudies  of  Chaptar  4 varlod  both  the  contrast  ratio  of 

1 i 

the  display  and  tha  bandwidth.  The  VOM's  had  to  account  for  the  visual 
effects  of  only  one  parameter  in  the  film  study  comparsd  to  the  two 
parameters  of  the  video  study.  Thus  the  video  study  of  Chaptar  4 
represents  a more  critical  test  of  the  FCM's  than  doss  tha  film  study. 

Since  the  study  described  in  this  chapter  was  dona  with  a 
directly  viewed  film  display,  with  no  intervening  video  system,  ik  is 
difficult  to  make  absolute  performance  laval  comparisons  with  the  target 
recognition  study  of  Chapter  4.  The  performance  level  of  the  film  utudy 
wet  much  higher,  but  it  la  Impossible  to  determine  how  much  of  this  wee 
due  to  increased  subject  training  And  how  much  wee  due  i < Improved  image 
quality. 

Despite  the  Inconclusiveness  of  the  results  shown  in  Table  17, 
two  significant  points  are  evident.  First,  the  limiting  resolution  and 
equivalent  bandpass  are  once  again  found  at  the  bottom  of  the  list  of 
correlations.  Second,  tha  log  BLMTFA  end  JNDA-log  (1/2  cpd)  correlate 
very  highly  with  performance,  preserving  their  position  as  the  most 
promising  display  system  FOM's.  Graphs  of  these  correlations  are  in 
Appendix  C. 
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CHAPTER  6 


DISCUSSION  AND  MODEL  DEVELOPMENT 

Table  18  la  a summary  of  cho  FOM'*  Investigated  and  thalr 
correlation  with  performance  for  the  four  taeka  deecribed  in  Chapter*  4 
and  5.  Table  19  ahows  the  rank  order  of  the  FOM'a  for  each  of  the  four 
performance  taeka.  The  laat  column  of  Table  19  ia  aomewhat  misleading 
dun  to  the  very  high  correlation*  that  war*  obtained  for  almoat  all  of 
the  FOM'a.  To  determine  whether  or  not  the  difference*  in  correlation 
coefficient*  among  the  FOM'a  were  atatiatically  aignif leant,  a atatie- 
tical  analyela  waa  done  uaing  a method  developed  by  Hotelling 
(Guilford,  1965,  p.  191).  The  FOM  with  the  hlgheat  correlation  for  each 
of  the  four  taaka  waa  analyaed  to  determine  if  it  waa  atatiatically 
higher  than  the  other  FOM’a.  Appendix  D deacribea  the  equation  and 
procedure  uaed  to  accomplish  thla.  The  log  BLMTFA  correlated  highest 
with  performance  for  the  first  three  performance  taaka  of  Table  18. 

Table  20  ahows  the  probability  level  (or  nonsignificancs)  obtained  by 
atatiatically  comparing  the  log  BLMTFA  with  each  of  the  other  FOM'a. 

For  the  film  study  described  in  Chapter  5 the  FOM  that  correlated 
hlgheat  with  performance  was  the  log  JNDA.  Table  21  statistically 
comperes  thla  FOM  with  the  others  to  determine  if  It  la  atatiatically 
higher  in  correlation  with  performance. 
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Target 
Recognition 
(Television  Study) 


Target  Detection  Target 
POL  1000  POL  2000  Recognition 

(Television  Study)  (Film  Study) 


Table  19.  Rank  order  of  the  FOM’s  for 


FOM 

Target 
Recognition 
(Television  Study) 

Log  BLMTFA 

1 

JNDA-Log  (1/2  cpd) 

2 

Log  S.T.  Rea 

3 

Log  JNDA 

4 

JNDA-Log  (2  cpd) 

5 

S.T.  Res 

6 

Log  MTFA 

7 

JNDA 

8 

Log  SSMTFA 

9 

GFP-Log 

10 

Log  Info  Dens 

11 

ICS 

12 

MTFA 

13 

Info  Dene 

14 

Log  Lim  Res 

IS 

SQF 

16 

GFP 

17 

Lim  Res 

18 

Ns 

19 
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four  performance  teaks 


Target  Detection  Target 
POL  1000  POL  2000  Recognition 
(Television  Study)  (Film  Study) 


1 

1 

8 

V’.;|  .•  ' 

2 

3 

3 

3 

2 

12 

4 

5 

1 j ’ 

5 

6 

2 

6 

7 

10 

10 

9 

13 

8 

8 

4 ; 

11 

11 

6 

9 

12 

16 

7 

4 

11 

12 

13 

7 

13 

14 

14 

14 

10 

i 

9 I 

1 

17 

15 

15 

15 

16 

5 

* 

! 

16 

18 

V 

\ 

18 

17 

17 

j 

’• 

■i! 

19 

19 

18 

Table  20.  Statiatlcal  probability  level  that  the  top  Hated  FOM  ia  more 
highly  correlated  with  performance  for  the  performance  taaka 
of  Chapter  4 (NS  means  not  significant  at  p ■ 0.05  level) 


Log  8LMTFA 

JNDA-Log 
(1/2  cpd) 

Log  S.T.  Res 

Log  JNDA 

JNDA-Log  (2  cpd) 

S.T.  Res 

Log  MTFA 

JNDA 

Lor  SSMTFA 

GFP-Log 

Log  Info  Dens 

ICS 

MTFA 

Info  Dens 
Log  Llm  Res 
SQF 
GFP 

Llm  Res 


5 

Performance 

Taak 

FOM 

Target  Recognition 

POL  1000 

1 

POL  2000  4 

. 

Probability,  p< 

Probability, 

P< 

Probability,  p<  1 

Table  21.  Statietlcal  probability  level  that  tha  top  llatad  FOM  la  more 
highly  correlated  with  parfomanca  than  the  other  FOM*  a for 
the  film  study  of  Chapter  5 (MS  neaoa  not  algnlf leant  at  the 
p ■ 0.05  level) 


FOM 

Performance  Teak 

Film  Study 

Probability,  p< 

Log  JNDA 

— 

JNUA 

NS 

JNDA-Log  (2  cpd) 

NS 

JNDA-Log  (1/2  cpd) 

NS 

Log  SSKTFA 

NS 

ICS 

NS 

Log  BLMTFA 

NS 

Info  Dens 

NS 

S.T.  Res 

NS 

Log  Info  Dena 

NS 

Log  S.T.  Res 

NS 

Log  MTFA 

NS 

MTFA 

0.05 

Log  Llm  Rea 

0.05 

SQF 

NS 

GFP-Log 

0.025 

Llm  Rea 

0.05 

N. 

0.025 
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It  is  spparsnt  from  the  statistical  analysis  shown  in  Tables  20 
and  21  that  it  is  impossible  to  confidently  select  one  of  the  FOM'a  as 
clearly  superior  to  all  of  the  others.  The  thres  FOM'b  that  show  the 
most  promise  are  the  log  BLMTFA,  the  JNDA-Log  (1/2  cpd),  and  the  JNDA- 
log  (2  cpd) . Table  20  shows  that  the  JNDA-log  (1/2  cpd)  and  the  JNDA- 
log  (2  cop)  are  the  only  FOM'a  that  are  not  significantly  lower  than  the 
log  BLMTFA  for  all  three  performance  tasks.  None  of  these  three  had  the 
highest  correlation  with  performance  for  the  film  study;  however,  they 
both  correlated  very  highly  with  performance,  and  a statistical  analysis 
showed  that  there  was  not  a significant  difference  between  these  FOM's 
in  correlating  with  performance. 

A cautionary  note  must  ba  injected  concerning  the  application  of 
these  FOM's  to  operational  display  systems.  Performance  for  the  target 
recognition  studies  was  measured  in  terms  of  the  angular  size  of  the 
target  at  recognition.  However,  this  may  not  be  the  important  perform- 
ance variable  from  an  operational  standpoint.  The  problem  arises  for 
display  situations  In  which  the  angular  size  of  the  display  is  the 
Independent  variable,  as  in  the  film  study  of  Chapter  5.  The  angular 
MTF  and  subjective  quality  of  the  display  Improve  as  the  display  is 
moved  away  from  the  obaerver.  Alao,  the  performance,  in  terms  of  the 
angular  size  of  the  target,  Improves  (decreases)  as  the  value  of  the 
FOM's  increases.  However,  the  percent  of  the  display  that  the  target 
must  occupy  for  recognition  to  occur  increases  as  the  display  is  moved 
further  away.  This  corresponds  to  a more  inefficient  sensor/display 
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observer  system  in  terms  of  the  visual  information  transfarrad  from  tha 
aanaor  to  tha  obaarvar. 

Table  22  shows  tha  percent  of  the  display  required  for  target 
recognition  calculated  from  tha  film  study  of  Chapter  5.  The  lower  the 
percentage  of  the  display  that  tha  target  must  occupy  for  recognition  to 
occur,  tha  longer  the  slant  range  to  the  target  at  recognition,  if  the 
sensor  field  of  view  (FOV)  is  kept  constant.  Tha  important  operational 
performance  parameter  la  the  distance  at  which  a target  can  be  detected 
or  recognised.  Thus,  it  is  desirable  to  arrange  a display  system  to 
improve  this  capability  as  much  ss  possibla.  The  calculated  value*  of 
the  FOM's  do  not,  by  themselves,  provide  sufficient  information  to 
determine  the  effect  of  display  angular  aubtenae  on  this  operational 
performance.  This  inadequacy  la  e severe  shortcoming  of  ell  the  FOM'a 
investigated  end,  to  eoma  extent,  of  the  FOM  concept  in  general.  The 
objective  of  the  FOM  concept  wee  to  develop  a means  of  quantifying  image 
quality  to  relate  to  observer  performance.  This  objective  has  baen 
successfully  attained  for  several  display  variables,  if  one  is  concerned 
about  the  angle  subtended  by  the  target  st  recognition.  However,  for 
many  display  applications  a more  meaningful  measure  of  performance  la 
the  efficiency  of  the  diapley/observer  interface.  This  efficiency  can 
be  expressed  in  terms  of  the  percent  of  the  display  thet  the  target  must 
occupy  for  target  detection  or  recognition  to  occur.  The  emaller  the 
percentage,  the  better  the  performance. 

This  approach  is  more  in  the  realm  of  developing  a model  to 


predict  absolute  performance  levels  rathsr  than  relative  performance, 

n 


which  was  tha  objective  of  the  FOM  concept.  However,  the  potential 
utility  of  a successful  target  detection  or  recognition  model  is 
sufficient  to  warrant  a brief  discussion  of  a possible  approach.  The 
objective  of  this  discussion  is  to  determine  if  the  data  shown  in 
Table  22  can  be  reasonably  predicted  using  a simple  approach  to  a target 
recognition  model. 


Table  22.  Percent  of  display  width  required  for  recognition  for  six 
viewing  distr.es;  from  the  target  recognition  study  of 
Chapter  5 


Viewing  Distance 
(meters) 

*Kifciataj-awTer  rwt»is;ion.«ieie,:w enw 

Angular  Width 
of  Display 
(degrees) 

Percent  of  Display  Width 
Required  for  kecognition 

4.37 

1.765 

13.03 

2.91 

2.650 

8,19 

2.18 

3.537 

6.53 

1.46 

5.279 

4.53 

1.09 

7.067 

3.92 

0.73 

10.536 

3.02 

There  are  two  easily  defined  extremes  that  can  occur  for  a 
display/observer  interface!  1)  a severely  display-limited  case,  and 
2)  a severely  vision-limited  case. 

For  the  first  case  the  display  is  situated  very  close  to  the 
observer  and  has  a very  low  resolution  compared  to  the  visual  acuity  of 
the  observer.  Thus  the  observer  can  easily  resolve  all  of  the  visual 
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Information  that  tha  display  can  prasant.  Tha  limiting  factor  in  this 
case  la  tha  diaplay/sanaor  capability.  Tharafore,  tha  parcant  of  tha 
display  that  the  target  must  occupy  for  recognition  to  occur  is  tha 
ratio  of  the  number  of  raaolution  elements  required  across  the  target  to 
tha  total  number  of  resolution  elements  across  tha  display  (times  100 
for  parcant).  As  a simple  example,  consider  a tri-bar  target.  Thera 
must  be  a minimum  of  five  resolution  elements  across  the  target  to 
resolve  its  pattern  as  determined  by  the  Nyquist  limit.  If  the  display 
is  capable  of  100  resolution  elements  across  one  dimension,  then  the 
target  must  occupy  5 percent  of  that  display  dimension.  In  general, 
this  display  limit  can  be  expressed  as: 


(display  limit)  100 


(ID 


where 

X D - percent  of  the  display  that  the  target  must  occupy  for 
recognition  to  occur 

Nt  » number  of  resolution  elements  required  to  recognize 
target  (along  one  dimension) 

Np  - number  of  resolution  elements  across  one  dimension  of  the 
display 


The  second  extreme  is  tha  vision-limited  situation.  This 
occurs  for  cases  where  the  angular  size  of  an  individual  display 


resolution  element  Is  much  smaller  chan  the  angular  resolution  limit 
of  Che  eye  (1  to  1-1/2  minutes  of  arc).  Thus  the  limiting  factor  for 
this  case  is  visual  acuity.  This  means  that  the  target  must  subtend  a 
minimum  angle  for  recognition  to  occur.  For  the  tri-bar  target  example, 
the  target  must  subtend  5 to  7-1/2  minutes  of  arc  (depending  on  the 
visual  resolution  limit  used)  for  the  target  to  be  resolved.  This 
number  is  obtained  by  multiplying  the  number  of  resolution  slements 
required  to  resolve  the  target  times  the  angular  resolution  limit  of  the 
eye.  The  percent  of  the  display  that  the  target  must  occupy  for  this 
pass  is  given  by: 


(vision  limit)  X D 


100 


(12) 


where 

0<j  ■ required  angular  target  size 
0jj  - angular  size  of  the  display 

X D ■ percent  of  display  required  for  recognition  to  occur 
Equations  (11)  and  (12)  describe  the  percent  of  the  display 
required  for  display/observer  extremes  or  limits.  The  problem  is  how 
does  one  determine  the  requirements  for  intermediate,  non-extreme  cases? 
The  simplest  approach  is  to  simply  ndd  the  two  quantities  together. 

Thus,  combining  equations  (11)  and  (12)  in  this  manner: 


/0T  Nt\ 

(general  case)  X D ■ ^ ^ J 100 


(13) 


IS 


It  should  be  noted  that  In  this  simple  modeling  approach  0T  is 


calculated  using: 


0p  ■ 0y 


where 

0V  - limiting  visual  acuity  (in  degrees) 

Some  assumption  must  be  made  to  establish  numbers  for  6y,  Np  and 
Np.  The  visual  acuity  limit,  0y,  is  assumed  to  be  1-1/2  minutes  of  arc 
which  is  the  largest  value  of  the  1 to  1-1/2  minutes  of  arc  typically 
ascribed  to  this  parameter  (Riggs,  1965).  Since  the  targets  used  were 
somewhat .similar  in  nature  to  those  used  by  Johnson  (1966)  in  estab- 
lishing the  "Johnson  criteria,"  these  criteria  are  employed.  The 
Johnson  criteria  state  that  target  recognition  occurs  for  a display/ 
observer  condition  wherein  the  observer  can  resolve  a periodic  bar  target 
of  4.0  ± 0.8  cycles  that  is  the  same  size  as  the  target.  Thus  Np  is 
approximately  eight  resolution  elements  (assuming  two  samples  per  cycle). 
The  useful  limiting  resolution  of  a display  has  been  designated  as  the 
spatial  frequency  at  which  the  modulation  contrast  drops  below  about 
two  to  five  percent  (Brock,  1967;  Dyall,  1978).  The  number  of  resolution 
elements,  Np,  is  estimated  to  be  the  minimum  number  of  samples  required 
to  resolve  the  spatial  frequency  at  which  the  display  MTF  drops  to 
3-1/2  percent  (midway  between  2 and  5 percent).  For  the  film  study  of 
Chapter  5,  Np  is  680. 
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Using  these  values  for  N-j , and  Mq  the  following  equation 
should  predict  the  results  shown  in  Table  22. 

(film  study)  X D - j ^ | 100  (14) 

The  six  viewing  dletancss  of  this  study  correspond  to  six  angular  j 

sices  for  the  display.  Table  23  shows  the  X D values  predicted  by  j 

equation  (14)  compared  to  the  actual  X D values  of  the  study.  Figure  6.1  j 

shows  the  theoretically  modeled  curve  of  X D vereus  0p.  The  circled 
points  in  Fig.  6.1  are  the  actual  data  pointa  from  the  study  of  Chapter  S. 

jj 

It  is  apparent  from  Table  23  and  Fig.  6.1  that  the  agreement  i; 

-'l 

.1 

between  the  model  and  actual  performance  le  excellent  considering  the  1 

)• 

simplicity  of  the  model  and  the  relative  crudenees  with  which  the 

i 

crlticel  values  In  the  modeling  equation  were  selected.  The  determination  < 

of  0T  and  NT  need  to  be  refined  to  be  aansltlve  to  subtle  changes  in 

| 

target  characterlatics  and  viaual  acuity,  but  the  overall  model  structure 

i 

appears  to  be  very  promising.  j 


i 


•? 
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Fig.  6.1.  Theoretical  modal  of  percent  of  display  width  required  for 
target  recognition  versus  angle  subtended  by  the  display 

The  circled  points  are  experimental  results  of  the  film 
study  described  in  Chapter  5. 


CHAPTER  7 


CONCLUSIONS 

Of  the  19  FOM's  investigated,  all  showed  a reasonable  degree  of 
correlation  with  performance,  which  la  somewhat  surprising  considering 
the  diverse  assumptions  and  theoretical  approaches  of  the  different 
FOM's, 

The  log  BLMTFA,  the  JNDA-log  (1/2  cpe),  and  the  JNDA-log  (2  cpd) 
showed  themselves  to  be  the  moat  promising  Indicators  of  image  quality 
baaed  on  the  results  of  this  dissertation.  Theaa  have  correlated  highly 
with  performance  Tor  target  recognition  and  target  detection  tasks  for 
studies  in  which  the  contrast  ratio,  bandwidth  and  viewing  distance  to 
the  display  have  been  varied,  Also,  they  are  affected  by  other  display 
system  variables  such  as  noise,  luminance,  and  others  that  were  not 
investigated  here.  It  rsmaina  to  be  seen  whether  or  not  these  FOM's 
will  still  correlate  well  with  performance  for  display  situations  in 
which  other  parameters  are  varied . 

It  may  not  be  possible  to  determine  which  FOM  la  clearly 
superior  to  all  of  the  others,  but  it  is  certainly  possible  to  eliminate 
soma  FOM's  from  consideration  as  inferior  to  the  more  highly  correlating 
FOM's.  The  limiting  resolution  and  the  equivalent  bandpass  are  two 


FOM'b  chat  are  widely  used  that  consistently  correlated  significantly 
lower  with  performance  than  the  higher-ranked  FOM’s.  Thie  la  atrong 
evidence  that  these  quantities  should  not  be  uaed  as  a means  of 
describing  the  overall  image  quality  of  a display  system. 

The  failure  of  the  gray-shada  transformation  to  correlate  veil 
with  performance  Indicates  that  this  type  of  transformation  does  not 
produce  a quantity  that  is  linear  with  respect  to  visual  information. 
The  relative  success  of  the  JNDA-log  (1/2  cpd)  and  JNDA-log  (2  cpd) 
Indicate  that  the  lower  modulation  contrast  levels  should  probably  ba 
weighted  more  heavily  than  the  higher  levels,  which  is  opposite  of  tha 
gray-shade  transformation  effect. 

The  success  of  the  modeling  approach  described  in  Chapter  6 
indicates  that  it  nury  be  more  advantageous  to  develop  methods  of 
predicting  absolute  performance  levels  rather  thAn  spend  time  and 
effort  developing  alternative  FOM’a  for  display  systems. 

Overall,  this  dissertation  shows  that  thers  are  several  display 
syntem  figures  of  merit  that  are  probably  adequate  as  quentititlve 
indicators  of  image  quality. 
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APPENDIX  A 


SLANT  RANGE  AND  ANGLE  SUBTENDED  BY  TARGET 
AT  RECOGNITION  CALCULATIONS 


The  slant  range  to  the  target  at  detection  was  calculated  using 


the  equation! 


S - A 


1 + tan2 
»in2  (0  - a) 


where 


S ■ elant  range  to  target 
A » altitude  of  seneor 

a • depression  angle  of  sensor  from  horieontal 
$ - horieontal  field  angle  to  target 
8 » vertical  field  angle  to  v »rget 


$ * arctan 


^2w  tan  ( ~?r)  ^ 


w ■ horieontal  distance  on  display  screen  from  center  of  the 
display  to  the  target  (horieontal  coordinate) 

W • width  of  the  display  screen 


wfySaT' 


♦n  ■ total  horlaontal  flald  of  view  of  aanaor 


h * vortical  distance  on  diaplay  screen  from  center  of  dleplay 
to  the  target  (vertical  coordinate) 

H * height  of  display  scraan 
0m  ■ total  vertical  field  of  view  of  sensor 
Figure  A.l  was  used  to  derive  the  above  relationships. 

From  trigonometry  and  Fig.  A.l  the  following  relationships  are 
apparent i 


0-90-0+0 

L * — ~ 
cos  0 

* • tan  ♦ - (~t)  tan  ♦ 

s • (L*  + r2)1/2 


Substituting  (19)  and  (20)  into  (21) 1 

vl/2 


(L±t*nLi) 

V COS'  0 t 


(18) 

(19) 

(20) 
(21) 


M 


ititiuiiiii 


a tjJu-  ,J],  1'j'j j 


cob2  fi  ■ cos2  £$0#  + (6  - ct)J 

" £coa  90  cob  (0  - a)  - sin  (90*)  sin  (9  - a)J  ^ 


aln2  (0  - a) 


/ 1 + t*n2  » \ 
\sin2  (8  - a) / 


The  values  of  $ and  0 must  be  obtained  from  the  X,  Y coordinates 
of  the  target  on  the  display  screen.  The  derivation  is  the  same  for  both 
vertical  and  horiaoutal  dimension*  so  only  the  vertical  will  be  considered 
in  detail-  Figure  A. 2 ahowa  a plan  view  of  a display  situation.  The 
distance  labeled  D is  a dummy  distance  convenient  for  derivation 
purposes.  The  maximum  vertical  field  of  view  of  the  aenaor  ia  0m;  this 
must  correspond  to  the  maximum  vertical  display  coordinate,  hi 

H/2 


/»m\  H/ 
( 2 ) ’ D 


solving  for  D 


f,  k 


2 un(S}) 
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APPENDIX  B | 

EQUIPMENT  USED  FOR  DISPLAY  MEASUREMENT  AND 
PSYCHOPHYSICAL  STUDIES 

Display  Measurement  Equipment 
Strip  Chart  Recorder:  Hewlett-Packard  Model  7101B 
Oscilloscope  : Tektronix  Model  7613 

Telephotometer:  Spectra  Pritchard  Mode].  1980  CDB,  Serial  No.  227  ! 

i 

TV  Test  Signal  Generator:  Systems  Research  Laboratories  Model  2550 
Video  Teat  Generator:  Colorado  Video  Inc.  Model  615 

i 

Psychophysical  Study  Equipment  j 

16mm  Movie  Projector:  L.W.  Photo,  Inc.  Athena  Model  4000  TSM 

1 

Cross  Hair  Generator/Video  Digitizer;  Systems  Research  Laboratories  - ) 

Custom  built  j 

TV  Camera:  Cohu  Electronics  Inc.  Model  2810  ! 

I 

TV  Monitor  : Hewlett-Packard  - Model  6946A 
TV  Monitor:  Tektronix  Model  632  Serial  No.  700871 

i 

Video  Filter:  Systems  Research  Laboratories  - Custom  built  \ 
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APPENDIX  C 

CORRELATION  GRAPHS)  PERFORMANCE  VERSUS  FCM'S 

This  taction  contains  graphs  showing  the  best  linear  fit  (least 
squares  fit)  for  the  relationship  between  observer  performance  and  the 
FOM's.  The  actual  data  points  are  shown  on  the  graphs  enclosed  in 
small  circles.  The  graphs  are  organized  in  rank  order  of  their  corre- 
lation coefficient  for  the  first  target  recognition  study  (Chapter  4). 
The  correlation  coefficients  and  rank  order  are  summarized  in  Tables  14 
through  17  in  Chapter  6. 
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LOO  BLMTFA 


le  subtended  by  target  at  recognition  versus 
the  target  recognition  study  of  Chapter  4, 
le  subtended  by  target  at  recognition  versus 
the  target  recognition  study  of  Chapter  5 
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LOG  BLMTFA 


LOO  BLMrFA 


Fig.  C.2.  A)  Graph  of  alant  range  to  target  at  detection  versus  log 
BLMTFA  for  POL  targets  and  simulated  altitude  of  1000  feet 
B)  graph  of  alant  range  to  target  at  detection  versus  log 
BLMTFA  for  POL  targets  and  simulated  altitude  of  2000  feet 
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Fig.  C.4.  A)  Graph  of  alant  rang*  to  target  at  detection  veraue 

JNDA-log  for  POL  targeta  and  simulated  altitude  of  1000  feet 
B)  graph  of  slant  range  to  target  at  detection  vereua 
JNDA-log  for  POL  targete  and  elmulated  altitude  of  2000  feet 
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LOQ  SUPIWTHRESNOIO  RESOLUTION 


LOO  SUPRATHRE SHOLD  RESOLUTION 


A)  Graph  of  angla  aubtandad  by  targat  at  racognition  varaua 
log  Suprathraahold  Raaolutlon  for  tha  targat  racognition 
atudy  of  Chaptar  4,  B)  graph  of  angla  aubtandad  by  targat 
at  racognition  varaua  log  Suprathraahold  Raaolutlon  for  tha 
targat  racognition  atudy  of  Chaptar  5 
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LOO  SUPRATHRESHOLD  RESOLUTION 


Fig.  C.6.  A)  Graph  of  alant  ranga  to  targat  at  dataction  varaua  log 
Suprathraahold  Raaolutlon  for  POL  targata  and  almulatad 
altituda  of  1000  faat.  B)  graph  of  alant  ranga  to  targat 
at  dataction  varaua  log  Suprathraahold  Raaolutlon  for  POL 
targata  and  almulatad  altituda  of  2000  faat 
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Tig,  C,l,  k)  Graph  of  aiant  rang*  to  targat  at  dataetlon  vartua  log 
JNDA  for  POL  targata  and  slwulatad  altituda  of  1000  faot, 
I)  graph  of  slant  ranga  to  targat  at  dataetlon  varaus  log 
JNDA  for  POL  targata  and  ainulatad  altituda  of  2000  faat 
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Fig.  C.9.  A)  Graph  of  angla  aubtandad  by 
JHDA-log  (2  cpd)  for  cha  targai 
Chaptar  A,  B)  graph  of  angla  hi 
raeogniclon  varaua  JNDA-iog  (2 
tion  atudy  of  Chaptar  3 


RWiJ 


6 


o 
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Fig.  C.IO.  A)  Graph  of  alant  rang*  to  targat  at  datactlon  varsua 

JHDA-log  (2  cpd)  for  FOL  targata  and  alnulatad  altltuda  of 
1000  faat»  B)  graph  of  slant  ranga  to  targat  at  datactlon 
varavia  JNDA-log  (2  cpd)  for  FOL  targata  and  alnulatad 
altltuda  of  2000  faat 


SURRATHRESHQLD  RESOLUTION 

F.ljj * C.  11.  A)  Graph  of  angle  aub tended  by  eargat  at  racognltlon  varauo 
Suprathreehold  Raaolution  for  the  target  recognition  atudy 
of  Chapter  4,  B)  graph  of  angle  eubtended  by  target  at 
recognition  veraue  Suprathreehold  Raaolution  for  the  target 
recognition  atudy  of  Chapter  5 
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SUMATHRESHOLD  RESOLUTION 


C.12. 


SUPRATHRE5HOLD  RESOLUTION 


A)  Graph  of  slant  rang#  to  target  at  detection  varaus 
Suprathraahold  Resolution  for  POL  targets  and  simulated 
altitude  of  1000  feet,  B)  graph  of  slant  range  to  target 
at  detection  versus  Suprathrsshold  Resolution  for  POL 
targets  and  simulated  altitude  of  2000  feet 
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Fig,  C.13.  A)  Graph  o £ angla  subtended  by  target  at  recognition  versus 
log  MTFA  for  tha  targat  recognition  study  of  Chapter  4, 

B)  graph  of  angle  aubtandad  by  targat  at  raeognition  versus 
log  MTFA  for  tha  targat  recognition  study  of  Chapter  5 
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Fig.  C.15.  A)  Graph  of  angle  aubtandad  by  targat  at  recognition  varaua 
JHDA  for  tha  targat  racognltlon  study  of  Chap tar  4, 

B)  graph  of  angle  aubtandad  by  targat  at  recognition  varaua 
JNDA  for  Che  targat  recognition  study  of  Chapter  5 


LOG  SSMTFA 


Fig.  C. 17,  A)  Graph  of  angle  subtended  by  target  at  recognition  veraua 
log  SSMTFA  for  the  target  recognition  study  of  Chapter  4, 

B)  graph  of  angle  subtended  by  target  at  recognition  versus 
log  SSMTFA  for  the  target  recognition  study  of  Chapter  5 


QFP-LOO 


Fig,  C.19.  A)  Graph  of  angla  aubcandad  by  targat  at  raoognition 

varaua  CJFP-log  (1  cpd'  for  tha  targat  racognieion  atudy 
of  Chaptar  4,  B)  grapft  of  angla  aubtandad  by  targat  at 
raoognition  varaua  OFF- log  (1  cpd)'  for  tha  targat 
raoognition  atudy  of  Chaptar  5 


C. 20.  A)  Graph  of  slant  rang*  to  targat  at  datactlon  varaua 
GFP-log  (1  cpd)  for  POL  targats  and  almulatad  altltuda 
of  1000  fast,  B)  graph  of  alant  ranga  to  targat  at 
datactlon  varaua  GFP-log  (1  cpd)  for  POL  targata  and 
alnulatad  altltuda  of  2000  faat 
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LOS  INFORMATION  DENSITY 


COO  INFORMATION  DENSITY 

C.21.  A)  Graph  of  angla  aubtandad  by  targat  at  racognltlon 
varaua  log  Information  Oanaity  for  tha  targat 
racognltlon  atudy  of  Chaptar  4,  B)  graph  of  angla 
•ubtandad  by  targat  at  racognltlon  varaua  log  Informa 
tlon  Danalty  for  tha  targat  racognltlon  atudy  of 
Chaptar  5 


10Q  INFORMATION  DENSITY 


Fig, 


C.22. 


A)  Graph  of  alant  ranga  to  targat  at  dataotion  voraua 
log  Information  Danaity  for  POL  targata  and  almulatad 

at^ataptin  1000  B!  ?raph  of  ilant  r*n|*  t0 

at  datactlon  varaua  log  Information  Danaitv  for  POL 

targata  and  almulatad  altltuda  of  2000  fact 


Fig.  C.24.  A)  Graph  of  aline  tango  to  targat  at  datactlon  varaua 
ICS  for  POL  targata  and  aimulatad  altituda  of  1000 
faat,  B)  graph  of  alant  ranga  to  targat  at  datactlon 
varaua  ICS  for  POL  targata  and  aimulatad  altituda  of 
2000  fait 


Pig.  C.26.  A)  Graph  of  alant  rang*  to  targat  at  dataction  varaua 
MTFA  for  POL  targata  and  aimulatad  altitude  of  1000 
faatt  B)  graph  of  alant  ranga  to  targat  at  dataction 
varaua  MTFA  for  POL  targata  and  aimulatad  altitude  of 
2000  faat 
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INFORMATION  DENSITY 


Fig.  C.27. 


A)  Graph  of  angle  'lubtanded  by  target  at  racognltion 
vtroua  Information  Density  for  the  target  recognition 
study  of  Chapter  4,  B)  graph  of  angle  subtended  by 
target  at  recognition  versus  Information  Density  for 
the  target  recognition  study  of  Chapter  5 
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INFORMATION  DENSITY 


INFORMATION  DENSITY 


C.28.  A)  Graph  of  slant  ranga  to  targat  at  detaction  varaua 
Information  Density  for  POL  targets  and  simulated 
altitude  of  1000  feett  B)  graph  of  slant  ranga  to 
targat  at  detection  varsue  Information  Danaity  for 
POL  targets  and  simulated  altitude  of  2000  feet 
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LOB  LIMITING  RESOLUTION 
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LOB  LIMITING  RESOLUTION 

Fig,  C.29.  A)  Graph  of  angla  aubtandad  by  targat  at  recognition 
veraua  log  Limiting  Raaolution  for  the  target 
recognition  atudy  of  Chapter  4,  B)  graph  of  angle 
aubtended  by  target  at  recognition  veraua  log  Limiting 
Reaolution  for  the  target  recognition  atudy  of 
Chapter  5 
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LOO  LIMITING  RESOLUTION 


Fig.  C.30.  A)  Graph  of  slant  range  Co  carget  at  detection  versus 
log  Limiting  Resolution  for  POL  targets  end  simulated 
altitude  of  1000  feet,  B)  graph  of  slant  range  to 
target  at  detection  versus  log  Limiting  Resolution  for 
POL  targets  end  simulated  altitude  of  2000  feet 
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Fig.  C.31.  A)  Graph  of  angle  subtended  by  target  at  recognition  versus 
SQF  for  tha  target  recognition  study  of  Chapter  4, 

B)  graph  of  angle  subtended  by  target  at  recognition  versus 
SQF  for  the  target  recognition  study  of  Chapter  5 
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Fig.  C.32.  A)  Graph  of  slant  ranga  to  targat  at  datactlon  varaua 
SQF  for  POL  targata  and  aloulatad  altituda  of  1000 
fast,  B)  graph  of  slant  ranga  to  targat  at  dstaotion 
varaua  SQF  for  POL  targata  and  aimulatad  altituda  of 
2000  fast 
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Fig.  C.33.  A)  Oraph  of  angla  aubcandad  by  targat  at  racognition 
varaua  QFP  for  tha  targat  racognition  atudy  of 
Chaptar  4 
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LIMITING  RESOLUTION 


Fig.  C.36.  A)  Graph  of  slant  range  co  target  at  detection  veraua 
Limiting  Reaolution  for  POL  target!  and  eimulated 
altitude  of  1000  feet,  B)  graph  of  slant  range  to 
target  at  detection  versus  Limiting  Resolution  for 
POL  targets  and  simulated  altitude  of  2000  feet 


Fig.  C.37.  A)  Graph  of  angla  aubcandad  by  targat  at  raoognltlon 

varaua  Nt  for  tha  targat  raoognition  aeudy  of  Chaptar  4 
B)  graph  of  angla  aubtandad  by  targat  at  racognition 
varaua  N«  for  tha  targat  raoognltlon  atudy  of  Chaptar  3 
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STATISTICAL  CALCULATION  OF  SIGNIFICANT  DIFFERENCE 
BETWEEN  CORRELATION  COEFFICIENTS 


A method  for  determining  whether  or  not  two  correlation 
coefficients  are  significantly  different  was  found  in  Fundamental 
Statistics  in  Psychology  and  Education  by  Guilford  (1965).  The  method 
was  originally  developed  by  Hotelling  (1940).  Equation  (28),  derived 
by  Hotelling,  was  used  to  calculate  a t-value  from  which  the  level  of 
significance  was  obtained  from  a t-table. 


td, 


<*“12  - ri3) 


(N  - 3)  (1  + r23) 


.1/2 


I2(l  - r 


23 


12 


' r13  + 2r23ri?.ri3> 


(28) 


where 

tjr  - t score  for  a t-test 

rj2  ■ correlation  between  performance  and  FOM  1 
ria  ■ correlation  between  performance  and  FOM  2 
rj3  ■ correlation  between  FOM  1 a’nd  FOM  2 
N - number  of  data  points 
N-3  ■ degrees  of  freedom 
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If  performance  ie  represented  by  the  variable  Xj,  FOM  1 by  Xj, 
and  FOM  2 by  X3,  than  equation  (28)  is  applicable  only  if  X2  and  X) 
are  correlated.  This  was  the  case  for  all  of  the  FOM's  investigated. 

The  hypothesis  for  this  one-tailed  t-test  Is  that  there  la  no 
difference  between  |r^|  and  |ris|  or  that  (rig ) is  greater  than  | r 12 1 » 
The  level  of  significance  indicates  the  probability  that  this  hypothesis 


is  true. 
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